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ABSTRACT 


This  thesis  was  based  on  the  problem  of  improving  the  prediction 
of  freshman  success  at  the  University  of  Alberta,  Edmonton  with  high 
school  marks.  The  improvement  in  predictive  efficiency  by  categorizing 
the  data  by  size  of  graduating  high  school,  sex  of  student,  and  faculty 
entered  at  university  was  studied.  On  the  basis  of  the  categorization 
found  to  be  justified,  the  relative  predictive  values  of  two  sets  of 
high  school  marks- -the  Grade  XII  Departmental  Examination  and  the 
Principals'  Rating  scores--were  compared. 

The  sample  of  students  considered  in  the  study  was  1017  freshman 
students  who  had  entered  the  Faculties  of  Arts,  Education,  Engineering, 
and  Science  in  1962  and  for  whom  complete  Departmental  and  Principals' 
Rating  data  was  available.  The  analyses  of  this  data  led  to  the  find¬ 
ings  that: 

1.  consideration  of  the  size  of  graduating  high  school,  as 
determined  by  the  number  of  teachers  on  staff,  as  small  and  large 
schools  was  justified.  Marks  of  students  from  large  schools  were 
superior  to  marks  of  students  xrom  small  schools  in  their  correlation 
with  university  average. 

2.  marks  of  female  students  generally  were  better  predictors  of 
freshman  success  than  were  marks  of  male  students.  Categorization  ol 
data  by  sex  was  justified. 

3.  differentiation  of  the  criterion  scores  on  the  basis  of 
faculty  led  to  the  finding  that  high  school  marks  correlated  more  highly 
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with  university  average  in  Engineering  and  Science  than  with  the  average 
in  Arts  and  Education. 

4.  the  Principals'  Rating  scores  were  generally  as  effective  as 
the  Departmental  scores  in  their  ability  to  predict  the  freshman  average. 
For  only  one  of  the  fourteen  subgroups  evolved  was  the  Departmental 
battery  a  significantly  better  predictor. 

It  was  concluded  that,  for  the  purposes  of  educational  counselling 
and  provisional  university  admission  before  the  end  of  the  Grade  XII 
program,  the  Principals’  Ratings  could  be  used  effectively  to  predict 
freshman  success  at  the  University  of  Alberta.  Further,  this  prediction 
would  be  enhanced  by  the  consideration  of  the  sex,  size  of  the  graduating 
high  school,  and  the  faculty  the  student  intended  to  enter. 
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CHAFTER  I 


INTRODUCTION 

In  a  modern  technological  age,  the  efficient  use  of  human 
resources  has  become  a  challenge  to  the  institutions  of  society.  It  has 
become  axiomatic  that  our  talent  must  be  identified  and  our  manpower 
developed  if  maximal  productivity  is  to  be  reached  and  sustained.  From 
the  individual's  point  of  view,  reaching  a  level  of  self-fulfillment  and 
achievement  enhances  his  well-being. 

Because  today's  educational  systems  play  such  an  important  role 
in  the  identification  and  development  of  each  child's  talents,  the  fabric 
of  educational  objectives  has  the  thread  of  the  self-actualization  goal 
running  throughout.  As  the  educational  programs  have  become  increasingly 
diversified,  there  has  been  a  substantial  and  continuous  increase  in  the 
variety  and  number  of  decisions  that  must  be  made  which  concern  each 
student.  The  curriculum  route  chosen,  for  example,  has  direct  impli¬ 
cations  on  each  student's  subsequent  choice  of  vocational  area. 

Coupled  with  this  increase  in  the  number  of  educational  routes 
is  the  growing  pressure  for  advanced  education  in  virtually  every  field. 
Wrenn  (1962)  has  pointed  out  that  no  other  factor  is  as  important  to  the 
labor  force  entrants  of  the  1960's  as  the  level  of  education  they  have 
attained.  Not  only  must  the  student  reach  a  decision  regarding  his 
general  field  of  endeavor,  he  must  spend  an  increasing  length  of  time  in 
his  educational  preparation. 

It  is  no  accident  that  major  efforts  have  been  devoted  to  the 
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efficient  prediction  of  a  person's  success  in  a  position  or  program. 
Fishman  and  Pasanella  (i960),  for  example,  have  reviewed  over  six  hundred 
college  admission  studies  published  since  Garrett's  (1949)  and  Travers' 
(1949)  well  known  papers  in  the  same  area.  It  is  not  the  purpose  of 
this  study  to  review  predictive  studies  in  areas  other  than  those  relat¬ 
ing  to  the  articulation  between  the  high  school  and  college  but  the 
increased  emphasis  on  selection  and  placement  in  business  and  industry 
since  World  War  II  is  well  known.  It  would  seem  that  any  variable  that 
has  shown  signs  of  being  measurable  and  valuable  as  a  predictor  has  been 
seized  upon  in  the  hope  that  something  better  than  a  guess  can  be  made 
regarding  a  person's  possible  success  in  a  specified  task. 

Such  a  specified  task  is  the  university  program.  Woodside  (1958), 
in  reviewing  what  he  calls  the  "Canadian  crisis  in  higher  education, " 
says  that  the  growing  problem  to  be  faced  regarding  university  education 
can  be  expressed  in  two  ways.  First,  there  is  a  mounting  'tidal  wave" 
of  students  who  will  want  to  go  to  university.  The  tidal  wave  is  well 
illustrated  by  the  published  data  of  the  Dominion  Bureau  of  Statistics. 

In  1890,  only  three  per  cent  of  students  went  to  university  as  compared 
to  8.8  per  cent  in  1957.  The  Bureau  has  predicted  that  percentages  will 
increase  to  10  per  cent  by  1965  and  to  12.7  per  cent  by  1973* 

(Woodside,  1958;  p.  23.)  The  percentage  increase  in  students  desiring 
to  attend  university  will  be  compounded  both  by  a  generally  increasing 
population  and  by  general  prosperity  which  will  allow  young  adults  to 
study  for  longer  periods.  Sheffield  has  estimated  tnat  there  will  oe  a 
four-fold  increase  of  university  students  within  twenty  years  of  1955 
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(Woodside,  1958*  PP«  18-20).  Early  in  the  predicted  period,  these 
figures  have  already  been  found  to  be  very  conservative.  Seoondly,  the 
needs  of  the  country  for  men  and  women  in  education,  business,  science, 
medicine,  and  other  fields  has  not  been  met.  A  universal  shortage  of 
the  well-educated  already  exists  in  many  fields  and  this  will  accelerate 
as  our  industrial  complex  automates. 

In  this  situation  in  which  more  students  are  enrolling  in 
university  programs  and  more  university  graduates  are  needed,  Canadian 
universities  are  far  from  satisfied  with  the  utilization  of  talented 
youth.  In  19 56,  Dr.  Andrew  Stewart,  then  president  of  the  University 
of  Alberta,  said: 

Too  many  students  who  are  admitted  find  it  impossible,  under 
conscientious  direction  of  their  instructors,  to  meet  reasonable 
requirements  for  promotion. ...  We  do  not  know  how  many  competent 
students  fail  to  reach  University,  but  the  number  is  probably 
large  (Jackson  and  Fleming,  1957*  P«  80). 

T.  H.  Matthews,  another  Canadian  educator,  likens  the  attrition  in  the 
universities  to  a  disease  that  affects  thousands  of  young  Canadians. 

He  has  observed  that  about  one-third  of  the  high  school  students  who 
come  to  the  universities  fail  to  graduate  primarily  for  academic  rea¬ 
sons  (Matthews,  1957)* 

Further  to  the  serious  problem  of  many  failures  at  university 
is  the  tremendous  wastage  of  talent  resulting  from  drop-outs  during  or 
immediately  after  high  school.  Hollinshead  has  estimated  that  of  the 
one-quarter  of  the  total  U.  S.  population  with  I  Q  ratings  of  more  than 
110,  only  four-fifths  finish  high  school  and  only  two -fifths  enrol  in 
university  (Woodside,  1958).  Canadian  studies  have  found  similar 
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attrition  rates.  Jackson’s  study  of  Province  A,  thought  to  be  Ontario, 
found  that  up  to  yQ  per  cent  oi  the  most  intelligent  of  Canadian  young 
people,  I  Q,  over  140,  fail  to  finish  high  school  (Woodside,  1958;  p.  54). 
A  longitudinal  study  in  Alberta  vas  concerned  with  the  academic  progress 
of  100  students  enrolled  in  grade  nine  in  1949  (Jackson  and  Fleming, 

1957;  P*  87).  Only  nine  of  these  100  students  secured  their  university 
entrance;  only  four  had  received  or  were  still  working  for  their 
university  degrees  in  1955*  Black  (1961)  in  his  Alberta  survey  of  the 
academically  gifted  does  not  agree  with  the  dramatic  figures  cited  above 
by  Woodside,  but  although  the  percentage  is  lower,  the  wastage  is  too 
high  to  ignore. 

The  seriousness  of  this  wastage  has  led  educators  to  ask  many 
piercing  questions,  foremost  of  which  has  been,  "Who  should  go  to 
college?"  From  the  individual’s  point  of  view,  the  answer  could  be  to 
accept  all  those  who  have  both  the  desire  to  attend  university  and  the 
capabilities  which  could  be  further  developed  in  the  university  program. 
From  the  point  of  view  of  society,  the  ablest  of  youth  should  attend 
to  maximize  contributions  to  society.  The  current  high  failure  rate  at 
universities,  as  well  as  the  observations  that  many  able  students  are 
not  enrolling  in  university,  would  seem  to  indicate  that  the  problem  of 
"who  should  go  to  college"  has  not  been  solved  satisfactorily. 

Solutions  to  the  problem  which  have  been  attempted  assume  that 
there  is  some  method  of  predicting  an  individual's  need  for  and  chances 
of  success  in  university  study.  Angell  (1959)  asked  if  the  problem  was 
one  of  students  failing  in  one  program  when  they  might  have  succeeded 
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in  another,  or  one  of  completely  failing  to  identify  those  who  will 
benefit  most  from  a  university  education.  Both  problems  could  very  well 
exist.  There  is  an  immediate  need  for  gathering  the  prognostic  data 
together,  testing  its  value,  and  then  making  worthwhile  data  available 
to  senior  students ,  high  school  counsellors  and  university  admission 
officers . 

The  Problem 

The  present  study  was  concerned  with  the  general  problem  of  pre¬ 
dicting  academic  success  at  the  University  of  Alberta,  Edmonton.  More 
particularly,  it  was  concerned  with  the  comparative  predictive  abilities 
of  high  school  achievement  marks — Departmental  Examinations  and 
Principals’  Ratings.  Multiple  differential  correlation  techniques  were 
used  to  determine  the  comparative  value  of  the  two  batteries  of 
predictors  and  the  necessary  differentiations  to  make  among  the  data  to 
maximize  predictive  accuracy. 

Discussion  of  the  Problem 

Predictive  problems,  such  as  indicating  chances  of  success  at  the 
University  of  Alberta,  appear  to  consist  of  three  parts.  The  first  is 
the  task  of  selecting  individuals  according  to  predicted  fulfillment  of 
some  specified  criteria.  The  second  part  of  the  problem  is  one  of 
classifying  or  assigning  an  individual  to  one  of  several  categories,  for 
instance,  courses  of  study.  Thirdly,  there  is  the  educational  and 
vocational  guidance  problem  of  supplying  information  and  assistance  so 
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. . .  the  counselee  can  judge  the  relative  desirability  of 
certain  courses  of  action  by  considering  these  facts  along  with 
training  time  involved,  monetary  considerations,  social 
prestige,  or  the  like  (Gleser,  i960;  p.  1039). 

Essentially,  prediction  problems  may  be  problems  of  selection,  classifi¬ 
cation,  and  guidance.  Each  of  these  three  areas  is  of  concern  in 
Alberta  regarding  plans  for  and  entrance  to  the  University  of  Alberta. 

Results  of  the  Grade  XII  Departmental  Examinations  are  presently 
used  as  the  selection  criteria  to  the  University  of  Alberta.  These 
examinations  are  administered  for  the  Grade  XII  sub jects- -English  30 
(Literature  30  and  Language  30 ),  Social  Studies  30,  Mathematics  30, 
Sciences  (Chemistry  30,  Physics  30,  and  Biology  32),  and  a  foreign 
language.  The  tests  are  prepared  for  the  Department  of  Education  by 
appointed  school  officials  and  are  subject  to  review  and  approval  by  an 
examination  committee  in  each  subject.  The  battery  of  tests  is 
administered  at  the  end  of  June  to  all  qualified  Grade  XII  students  in 
the  province.  The  tests  are  composed  of  multiple -choice  items,  written 
short  answer  items,  and  full  essay -type  items  in  varying  proportions. 

The  examinations  are  marked  by  officials  employed  by  the  Department  and 
the  marks  are  standardized. 

The  general  view,  expressed  by  Stewart  above,  that  present 
selection  procedures  are  not  entirely  satisfactory  has  resulted  in  a 
plea  by  university  authorities  that  they  be  given  more  information  about 
prospective  students.  Many  admission  officers,  particularly  in  the 
United  States,  have  asked  for  the  high  school  record  of  the  student  and 
a  confidential  record  from  his  principal  as  supporting  evidence  of  a 
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student’s  chances  of  success  in  the  university  program. 

In  Alberta,  there  exists  such  a  report  for  the  Department  of 
Education.  The  Principals’  Confidential  Report  is  required  for  each 
student  enrolled  in  one  or  more  Grade  XII  Departmental  subjects.  This 
report  is  in  the  form  of  a  percentage  mark  for  each  Grade  XII  subject. 
Although  it  is  called  the  Principals’  Rating,  it  is  usually  a  pre¬ 
diction  by  each  subject  teacher  of  the  student’s  probable  mark  in  the 
Departmental  examination.  By  custom,  the  Grade  XII  Principals’  Rating 
is  based  to  a  large  extent  on  the  results  of  Easter  examinations  and  on 
the  year’s  course  work.  Its  main  function,  to  date,  has  been  to  serve 
as  a  basis  for  assigning  a  mark  to  those  few  students  who,  for  com¬ 
passionate  reasons,  are  unable  to  write  the  Departmental  Examinations. 

A  problem  undertaken  in  the  present  study  was  to  determine  if  these 
Principals’  Ratings  were,  in  fact,  a  valid  indication  of  the  student’s 
academic  achievement  and,  as  such,  a  useful  predictor  of  future 
academic  success. 

An  additional  problem  of  selection  of  university  candidates  was 
discussed  by  Dr.  Walter  Johns,  president  of  the  University  of  Alberta, 
at  a  recent  conference  of  Canadian  university  presidents  (Johns,  1961). 
The  differing  standards  of  entrance  for  each  Canadian  university  has 
created  many  problems  due,  in  part,  to  the  mobility  of  Canadian 
families.  The  possibility  of  instituting  a  national  college  entrance 
examination  has  been  suggested  as  a  means  of  selecting  students  (Johns, 
1961;  Black,  1963;  Graham,  19 64).  The  evaluation  of  such  an 
examination  would  be  facilitated  by  local  research  to  establisn  the 
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effectiveness  of  present  predictors.  Since  the  Principals’  Ratings  are 
available  in  Alberta  without  an  additional  testing  program,  their 
validity  in  selecting  university  candidates  could  serve  as  a  useful 
guideline . 

The  predictive  problem  of  classification  exists  in  many  forms  at 
the  University  of  Alberta.  Not  only  must  a  decision  be  made  regarding 
the  admission  of  a  student  to  university,  but  his  placement  in  one  of 
several  faculties  and  schools  must  be  made.  As  Angell  (1959)  emphasized, 
it  is  very  possible  that  a  student’s  chances  of  success  in  one  program 
are  quite  different  than  his  chances  in  another  program. 

The  problem  of  supplying  information  to  the  student  about  his 

probable  success  at  university  was  also  considered  in  the  present  study. 

The  dichotomy  of  clinical  versus  statistical  prediction  is  basic  to 

education  guidance.  Meehl  ( 195*0  has  perhaps  led  the  inquiry  into  the 

comparative  effectiveness  and  has  emphasized  the  possible  economy  in 

the  use  of  clinicians '  time  if  statistical  predictions  are  found  to  be 

as  valid  as  clinical.  Meehl  has  said: 

It  is  my  personal  hunch — that  a  very  considerable  fraction  of 
clinical  time  is  being  irrationally  expended  in  the  attempt  to 
do,  by  dynamic  formulations  and  staff  conferences,  selective 
and  prognostic  jobs  that  could  be  done  more  efficiently... 
through  systematic  and  persistent  cultivation  of  complex  (but 
still  clerical)  statistical  methods.  (Rosen  and  Van  Horn,  1961; 

p-  150) 

Several  studies  (Black,  i960;  Evenson  and  Smith,  1958:  Mack, 
1963;  Zurowsky ,  1959)  have  been  conducted  in  Alberta  to  determine  the 
statistical  data  needed  to  predict  success  at  the  University  of  Alberta 
from  the  Grade  XII  Departmental  results,  A  problem  undertaken  in  one 
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present  study  was  to  supply  information  to  the  high  school  student  on 
the  basis  of  the  Principals’  Ratings  which,  in  contrast  to  the  Depart¬ 
mental  results,  are  available  well  before  the  end  of  the  school  year. 

It  has  been  suggested  by  Henry  (1950)  that  those  concerned  with 
the  prediction  of  university  success  have  a  duty  to  continue  research 
aimed  at  the  improvement  of  predictive  efficiency  of  already-identified 
predictors,  the  search  for  new  predictor  variables,  and  the  decreasing 
of  time  and  cost  of  the  predictive  program.  The  present  study  attempted 
to  contribute  to  the  improvement  of  predictive  efficiency  and  to  the 
search  for  new  predictors  of  academic  success  at  the  University  of 
Alberta  by  considering  the  relationship  of  the  sex  of  the  freshman,  the 
size  of  high  school  he  attended,  and  the  faculty  he  entered  to  his 
academic  success  in  that  faculty. 
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CHAPTER  II 


REVIEW  OF  RESEARCH 


The  desire  to  make  accurate  predictions  of  success  in  university 
has  brought  about  a  multitude  of  research  studies  which  have  examined 
many  variables.  Recently,  new  statistical  techniques  and  modern  com¬ 
puters  have  enabled  investigators  to  examine  readily  more  variables,  to 
conduct  cross-validation  studies,  and  to  combine  the  predictor  variables 
in  various  combinations. 

The  number  and  type  of  predictor  variables  that  have  been 
studied  is  a  tribute  to  intellectual  curiosity.  One  reviewer,  Zurowsky, 
(1959)  found  that  the  following  factors  were  being  considered  in 
predictive  studies: 

„. .intelligence,  aptitude,  achievement,  motivation,  persistence, 
attitude,  personality,  interest,  age,  sex,  time  spent  in  study, 
reading  ability,  athletic  ability,  personal  history,  rank  in  high 
school  class,  determination  to  go  to  college,  English  expression, 
study  habits  and  empathy.  Then  also  there  has  been  recognition 
of  spontaneous  and  uncontrollable  factors  which  cannot  be  for- 
seen.  o .health  conditions,  social  circumstances,  sexual  distractions, 
home  problems,  temporary  moods,  sets  and  fatigue,  (p.  12). 

Such  factors  have  varied  in  both  measurability  and  effectiveness  as 
predictors . 


Previous  Reviews 

Reviews  by  Travers  (1949),  Garrett  0-949),  and  Henry  (1950)  are 
the  major  surveys  of  predictive  studies. 

Travers  (1949)  recounted  that  early  studies  were  concerned  with 
the  prediction  of  over-all  success  at  the  university  lever.  Such  studies 
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found  that  the  high  school  average  was  consistently  the  best  single 
predictor.  Following  in  order  of  validity  as  predictors  were  subject 
matter  tests  and  tests  of  scholastic  aptitude.  He  also  found  that 
consistently  low  correlations  were  derived  in  studies  of  non-intellectual 
factors,  such  as  level  of  adjustment  and  interests.  He  added  that  moti¬ 
vational  factors  played  a  major  role  in  determining  academic  success  but 
that  such  factors  could  not  be  adequately  measured  with  existing 
instruments.  He  observed  that  more  recent  studies  (19^9)  had  been  con¬ 
cerned  with  differential  predictions  of  academic  success  in  specific 
areas  and  such  studies  had  shown  it  to  be  a  promising  approach. 

Garrett's  review  (19^9)  was  very  extensive,  covering  hundreds  of 
studies.  He,  too,  found  that  the  high  school  average  continued  to  show 
the  highest  correlation  with  college  scholastic  average.  In  thirty-two 
studies,  the  correlation  of  high  school  average  to  university  average 
ranged  from  .29  to  .82,  with  a  median  of  .56.  He  found  that  the  high 
school  average  predicted  the  first  year  college  average  better  than  it 
predicted  any  lesser  or  greater  part  of  the  college  course.  Garrett 
found  that  of  the  many  forms  of  presenting  a  student's  high  school 
achievement,  the  high  school  average  and  percentile  rank-in-class  were 
most  commonly  used.  By  combining  the  variables  of  high  school  average 
and  high  school  percentile  rank,  investigators  arrived  at  a  multiple 
correlation  with  university  success  of  between  .60  and  .65*  Garrett 
concluded  that  research  showed  the  three  oest  predictors  c\  university 
success  to  be  high  school  scholarship,  general  achievement  tests,  and 
intelligence  test  scores. 
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Henry  (1950)  also  concluded  that  high  school  achievement  had  been 
shown  to  be  the  best  single  predictor.  College  aptitude  tests  were 
found  to  correlate  from  .25  to  .75  with  college  success,  being  fairly 
valid  if  devised  for  and  used  by  a  specific  college.  Personality 
measures  failed  to  demonstrate  any  appreciable  relationship  with  uni¬ 
versity  success  in  most  studies.  There  was  a  negative  correlation 
(r  =  -.25)  between  age  and  college  success  apparently  due  to  the  fact 
that  those  students  who  finish  high  school  at  a  comparatively  early  age 
have  had  greater  academic  success  in  high  school.  Other  factors,  such 
as  size  of  family,  nature  of  part-time  employment,  and  parental  occu¬ 
pation,  showed  either  no  relationship  or  inconsistent  correlations. 

Alberta  Studies 

The  research  findings  that  high  school  achievement,  standardized 
general  achievement  tests,  and  intelligence  test  scores  are  the  best 
predictors  of  university  success  have  been  tested  in  Aloerta. 

Comprehensive  studies  in  this  field  in  Alberta  began  in  late 
1954  with  the  establishment  by  the  Department  of  Education  of  a 
Matriculation  Study  Subcommittee  whose  purpose  it  was  to  examine  the 
"validity  of  the  present  predictive  system  of  selecting  students  for 
university  education"  (Evenson  and  Smith,  1957*  P*  08).  Ihe  lirst 
oroject  of  the  subcommittee  was  to  examine  the  most  recent,  complete 
academic  record  of  a  university  graduating  class.  The  freshman  class 
of  1951  was  selected  for  study.  The  study  was  concerned  with  the  pre¬ 
dictive  validity  of  such  factors  as  Grade  XII  Departmental  results  and 
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the  American  Council  on  Education’s  (ACE)  Psychological  Examination 
(Evenson  and  Smith,  1958). 

The  results,  reported  in  Table  I,  supported  the  finding  of  other 
studies  that  Grade  XXI  achievement  record  is  a  better  single  predictor 
of  university  freshman  success  than  an  intelligence  test  (ACE).  Further, 
the  ACE  consistently  showed  a  smaller  correlation  with  university 
average  of  each  subsequent  year  of  university  program  compared  to  the 
correlation  derived  by  using  Grade  XII  results.  The  1951  Freshman  Study 
also  found  that  the  best  predictor  of  senior  years’  success  in  university 
was  the  freshman  average  (Table  i).  A  major  weakness  of  this  study  was 
that  the  group  of  subjects  for  one  predictor  variable  was  not  the  same 
as  the  group  of  subjects  for  any  other  variable.  The  number  of  subjects 
in  the  comparison  groups  ranged  from  ll6  to  88l,  with  a  median  size  of 
l8l  subjects.  It  would  appear  impossible  to  make  precise  comparisons 
between  the  correlation  coefficient  as,  apparently,  the  size  and  nature 
of  the  comparison  groups  was  not  controlled. 

A  second  project  of  Matriculation  Study  Subcommittee  was  a  study 
of  the  1956  Grade  XII  graduating  class  in  Alberta.  Having  found  in  the 
1951  Freshman  Study  that  the  Grade  XII  Departmental  mark  was  the  best 
single  predictor  of  first  year  university  success,  the  subcommittee 
investigated  the  relationship  between  Grade  XII  marks  and  other  pre¬ 
dictors.  Specifically,  the  College  Entrance  Examination  Board’s  (CEEB) 
achievement  battery  and  Scholastic  Aptitude  Test  (SAT)  as  well  as  the 
School  and  College  Ability  Test  (SCAT)  were  studied  (Evenson  and  Smith, 
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CORRELATIONS  BETWEEN  UNIVERSITY  AVERAGE  AND  GRADE  XII  DEPARTMENTAL 
AVERAGE  AND  ACE  TOTAL  SCORE  FROM  1951  FRESHMAN  STUDY 
(After  Evenson  and  Smith,  195&) 
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1957). 

The  CEEB  examinations  have  been  used  for  many  years  by  many 
universities  in  the  U.S.A.  as  one  basis  for  the  selection  of  university 
students.  The  College  Entrance  Examination  Board  actually  serves  in  an 
advisory  and  supervisory  capacity  to  the  Educational  Testing  Service 
which  prepares  the  tests  and  conducts  the  examination  program.  In  a 
study  termed  "The  19 56  Grade  XII  Survey/’  the  Alberta  subcommittee 
chose  seven  of  the  CEEB  achievement  tests  and  SAT  to  administer  to  all 
Alberta  Grade  XII  students.  A  province-wide  sample  of  1435  students 
was  drawn.  The  students  were  assigned  to  21  groups  representing  all 
possible  combinations  of  two  CEEB  achievement  tests  from  the  battery  of 
seven  possible.  Each  student,  then,  wrote  two  of  the  CEEB  tests 
corresponding  to  his  Grade  XII  program.  Correlations  between  the  CEEB 
test  results  and  the  corresponding  Departmental  results  were  computed. 
The  correlation  coefficients  ranged  from  O.58  to  0.77*  with  a  median 
correlation  of  0.71  (Evenson  and  Smith,  1958)*  Despite  the  fact  that 
the  CEEB  examinations  were  written  for  and  normed  on  a  U.S.  population, 
they  apparently  correlate  well  with  Alberta  Grade  XII  Departmentals 
considering  the  differing  types  of  instruments. 

The  next  step  of  the  1956  Grade  XII  Survey  was  to  test  the 
validity  of  the  data  gathered  in  the  special  testing  program  to  predict 
university  success.  Correlations  between  CEEB  test  scores  and  university 
first  year  average  were  compared  with  correlations  between  Departmental 
marks  and  university  average  for  the  1956  freshman  class  (Table  II ). 
Although  the  significance  of  differences  was  not  computed,  due  perhaps 
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TABLE  II 

CORRELATIONS  BETWEEN  DEPARTMENTAL  GRADE  XII  SUBJECT  AND  CEEB 
ACHIEVEMENT  TEST  SCORES  AND  FRESHMAN  UNIVERSITY  AVERAGE 
(After  Evenson  and  Smith,  1958) 


CEEB  ACHIEVEMENT 
TEST 

NCEEB 

Correlation  With 

1st  Year  Univ.  Av.* 

^Dept , 

GRADE  XII  DEFT. 
SCORE 

CEEB 

rDept . 

ADV.  MATH 

298 

okl 

.56 

316 

MATH.  31 

INTERM.  MATH. 

178 

•  3^ 

.45 

609 

MATH.  30 

PHYSICS 

235 

.38 

<,58 

m 

PHYSICS  30 

CHEMISTRY 

182 

.38 

.56 

61k 

CHEMISTRY  30 

BIOLOGY 

67 

<,26 

.k2 

181 

BIOLOGY  32 

ENGLISH 

136 

.20 

,2k 

613 

ENGLISH  30 

FRENCH 

iko 

.29 

.43 

519 

FRENCH  30 

SAT  -  V 

660 

.27 

SAT  -  M 

659 

.30 

Comparison  Groups  Differ 
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to  the  varying  comparison  groups ,  it  appeared  that  Departmental  marks 
consistently  showed  a  higher  correlation  with  university  average  than 
did  the  CEEB  examinations.  Evenson  and  Smith  (1958)  concluded  that 
there  was  no  evidence  that  would  support  the  GEEB’s  replacing  the  com¬ 
parable  Departmental  examinations  in  selecting  university  students  in 
Alberta. 

The  1956  Grade  XII  Survey  gathered  other  information  such  as 
scores  on  SCAT,  responses  to  a  Student  Questionnaire  on  educational  and 
vocational  plans,  and  a  principal's  rating  for  each  student  on  such 
factors  as  initiative,  industry,  extracurricular  activities,  interests 
in  further  education,  and  overall  prospects  of  university  success. 
Analyses  have  been  conducted  on  only  a  small  part  of  this  data  (Evenson 
and  Smith,  1958).  The  correlation  between  SCAT,  Level  1,  and  university 
first  year  average  (Table  III)  was  very  low  and  indicated  that  existing 
intelligence  tests,  as  the  ACE  in  the  1951  Study  (Table  i),  are  of 
little  value  in  predicting  university  success.  Results  of  the  in¬ 
complete  analyses  of  the  Student  Questionnaire  and  principal’s  ratings 
on  the  nine  factors  showed  these  measures  to  be  of  limited  value 
(Evenson  and  Smith,  1958)* 

Black  (1959,  i960)  continued  the  analyses  of  data  gathered  in 
the  1956  Grade  XII  Survey.  To  compare  Grade  XII  Departmentals  with 
selected  standardized  tests  used  in  the  Subcommittee's  stuuy,  5^9 
the  1956  Grade  XII  class  who  took  part  in  the  special  testing  program 
and  who  entered  the  University  of  Alberta  in  19 56  were  selected  ior 
study.  The  1956  Study  had  provided  scores  for  each  student  on  two  of 
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TABLE  III 


CORRELATIONS  BETWEEN  SCHOOL  AND  COLLEGE  APTITUDE  TEST  AND  UNIVERSITY 
FRESHMAN  AVERAGE  FOR  19  56  GRADE  XII  SURVEY  GROUP 
(After  Evenson  and  Smith,  195^) 


PREDICTOR 

N 

CORRELATION  WITH 
UNIVERSITY  AVERAGE 

SCAT  -  Verbal 

6l6 

« — 1 

OJ 

• 

SCAT  -  Quantitative 

6l6 

.27 

SCAT  -  Total 

6l6 

.29 

• 

.  - 

. 

. 

19 


seven  CEEB  tests ,  Scholastic  Aptitude  Test,  Grade  IX  General  Test,  and 
SCAT  (Level  l).  The  University  Student  Advisory  Service  provided  scores 
on  ACE  Psychological  Examination  and  two  parts  of  the  Co-operative  Eng¬ 
lish  Test — Mechanics  of  Expression  (Part  A)  and  Reading  Comprehension 
(Part  C-2).  As  predictors  of  university  first  year  average,  these 
standardised  tests  ranked  from  best  to  poorest  in  the  order  of  CEEB,  SAT, 
SCAT,  ACE,  and  Grade  IX  General  Test  (Black,  1959)*  No  mention  was  made 
in  this  report  of  the  relative  effectiveness  of  the  Co-operative  English 
'Test.  Of  the  scholastic  aptitude,  or  intelligence  tests,  the  Scholastic 
Aptitude  Test  was  most  consistently  the  best  predictor  (Table  IV),  al¬ 
though  even  its  median  correlation  with  university  average  was  a  modest 
.35  (Table  IV). 

A  disadvantage  in  the  design  of  the  1956  Grade  XII  Survey  was 
that  each  student  wrote  only  two  of  the  CEEB  examinations  with  the  re¬ 
sult  that  comparison  groups  for  each  of  the  seven  CEEB  tests  were  differ¬ 
ent.  Only  limited  comparisons  could  be  made  among  the  correlations 
derived  by  each  of  the  CEEB  tests  with  university  average.  Black  (1959) 
in  comparing  each  of  the  CEEB  tests  with  the  corresponding  Departmental 
examination,  compared  the  correlations  derived  for  the  same  group  of 
students  for  the  two  predictor  variables.  It  was  impossiDle,  of  course, 
to  compare  the  CEEB  average  with  the  Departmental  average  for  the  same 
group  of  students  since  each  student  wrote  only  two  CEEB  tests.  After 
comparing  the  respective  correlations  with  university  average  101  the 
individual  CEEB  tests  and  Departmentals  for  the  same  group  of  students, 
(Table  V),  Black  (1959)  found  that  Departmentals,  with  the  exception  of 
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ION  COEFFICIENTS  BETWEEN  FOUR  ACADEMIC  APTITUDE  TEST 
SCORES  AND  UNIVERSITY  FRESHMAN  AVERAGE 
(After  Black,  1959) 
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TABLE  V 

CORRELATIONS  BETWEEN  CEEB  WITH  UNIVERSITY  AVERAGE  AND  GRADE  XII 
DEPARTMENT ALS  WITH  UNIVERSITY  FRESHMAN  AVERAGE 

(After  Black,  1959) 


CORRELATION  WITH 
UNIVERSITY  AVERAGE 

CEEB 

WCEEB 

rCEEB 

rDept 

^Dept 

GRADE  XII  DEPT. 

ADVo  MATH, 

2  46 

„4o8 

.572 

246 

MATH.  31 

INTER.  MATH. 

184 

.281 

,300 

184 

MATH,  30 

PHYSICS 

179 

.400 

.568 

179 

PHYSICS  30 

CHEMISTRY 

144 

.402 

.563 

144 

CHEMISTRY  30 

BIOLOGY 

49 

.347 

.552 

49 

BIOLOGY  32 

ENGLISH 

119 

,194 

.168 

119 

ENGLISH  30 

FRENCH 

ll6 

.354 

.470 

116 

FRENCH  30 
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English  30,  consistently  did  a  setter  job  of  predicting  university 
average  than  did  the  corresponding  CEEB  test .  Since  each  of  the  com¬ 
parison  groups  for  a  subject  area  were  the  same  in  Black's  study,  the 
derived  correlation  coefficients  varied  somewhat  from  those  found  by 
Evenson  and  Smith  (Table  II )  for  the  same  predictor  variables.  More 
assurance  could  be  placed  on  Black's  findings  of  the  relative  superior¬ 
ity  of  Departmentals  over  CEEB  examinations  since  he  controlled  many 
of  the  possible  contaminators  of  correlation  coefficients  through  his 
limited  matching  of  groups  of  students. 

Black  (1969)  and  Zurowsky  (1959)  applied  the  technique  of  multiple 
correlation  to  compare  combinations  of  the  standardized  tests  used  in 
the  1956  Grade  XII  Survey  with  combinations  of  Departmental  marks. 

Black  (i960)  considered  the  criterion  group  as  two  groups — total 
university  freshman  sample  (N  =  529)  and  Engineering  freshman  (N  =  131). 
Zero-order  correlation  coefficients  between  the  variables  and  university 
average  (Table  VI )  served  to  confirm  the  Departmentals'  effectiveness 
as  predictors.  The  three  best  single  predictors,  of  those  considered, 
were  Departmental  marks  in  Science,  Mathematics,  and  Foreign  Language 
for  both  of  the  criterion  groups  (Table  VI ).  The  differentiation  of 
the  criterion  groups  appeared  to  be  worthwhile  as  evidenced  by  the 
noticeable  difference  in  correlation  coefficients  between  them.  No 
doubt,  criterion  groups  which  did  not  share  membership  (Engineering 
freshmen  were  included  in  the  All  Faculties  group)  would  have  led  to 
even  greater  differences  in  the  relative  effectiveness  of  predictors. 

Following  the  technique  developed  by  Horst  (195*0,  Black  (i960) 
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TABLE  VI 

CORRELATION  BETWEEN  UNIVERSITY  AVERAGE  AND  SELECTED  PREDICTOR 
VARIABLES  FOR  UNIVERSITY  FRESHMEN  FROM  19  56  GRADE  XII  SURVEY 

(After  Black,  i960) 


PREDICTOR  VARIABLE* 

CORRELATION  WITH 

UNIVERSITY  AVERAGE 

.  _  - 

ALL  FACULTIES 
N  =  529 

ENGINEERING 

N  =  131 

ENGLISH  30 

.227 

.303 

SOCIAL  STUDIES  30 

.429 

.420 

GR.  XII  SCIENCES  AV. 

.632 

.620 

GR.  XII  MATH.  AV. 

.500 

.598 

FOR.  LANGUAGE 

.434 

.482 

SCAT  -  Verbal 

.234 

.266 

SCAT  -  Quantitative 

.276 

.254 

COOP  ENG.  MECHANICS 

.235 

.294 

COOP  ENG.  READING  COMP. 

.192 

.271 

CEEB  ADV.  MATH. 

- 

.400 

ACE  -  L 

- 

.361 

ACE  -  Q 

- 

.245 

SAT  -  V 

- 

.331 

SAT  -  M 

- 

.356 

*  Partial  List  only 
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compared  various  combinations  of  predictor  variables  on  the  basis  of 
multiple  correlations .  He  found  that  a  combination  of  the  seven  Grade 
XII  examination  scores  required  for  admission  to  Engineering  yielded  as 
great  a  multiple  correlation  coefficient  with  freshman  Engineering 
average  (Ry  =  .686)  as  the  combination  of  twenty-five  other  predictor 
variables,  the  standardized  tests  described  above  with  Grade  IX  Depart¬ 
mental  results  (R25  =  0687)  (Black,  i960,  p.45)*  Of  the  six  combina¬ 
tions  of  predictor  variables  he  studied.  Black  concluded  that  "the  five 
predictor  variables  of  Group  B  (English  30,  Social  Studies  30, 
Mathematics  Average,  Science  Average,  and  Foreign  Language  Average) 
were  deemed  the  best  operational  combination  for  all  the  university 
course  areas  studied"  (Black,  i960,  p.  45).  An  important  continuation 
of  this  study  would  seem  to  be  to  compare  the  predictive  effectiveness 
of  the  Departmental  results  with  that  of  a  combination  of  Departmental 
results  and  a  measure  of  scholastic  aptitude  (such  as  Scholastic 
Aptitude  Test).  The  incomplete  CEEB  scores  for  the  students  did  not 
appear  to  be  compensated  for  in  this  study  so  that  any  combinations  of 
predictor  variables  which  included  CEEB  scores  may  have  been  subject  to 
contaminating  factors  arising  from  difference  of  comparative  groups. 

The  results  of  Zurowsky's  (1959)  study,  which  were  included  in 
the  report  made  by  Black  (i960)  were  concerned  with  the  relative  pre¬ 
dictive  value  of  such  variables  as  Grade  IX  Depart mentals.  Grade  XII 
Departmentals,  SCAT,  Co-operative  English  Mechanics  and  Co-operative 
English  Reading  Comprehension  with  differential  criteria--selected 

and  business  administration  courses  as  well  as 


university  science 
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university  average.  The  subjects  in  this  study  were  the  529  members  of 
the  1956  Grade  XII  Survey  who  entered  the  university  in  1956. 

Against  the  criterion  of  university  average,  the  largest  zero- 
order  correlation  of  predictor  variables  was  found  to  be  that  of  Grade 
XII  Science  average  (r  =  .632).  The  multiple  correlation  between  a 
combination  of  the  Grade  XII  battery,  SCAT  (V  and  Q),  and  the  Co¬ 
operative  English  tests  with  the  criterion  of  university  average  was 
O.656  (Zurowsky,  1959*  PP*  69-71)“  The  actual  improvement  in  correla¬ 
tion  coefficients  by  using  the  entire  battery  of  predictor  variables 
rather  than  the  best  individual  predictor,  which  was  the  Grade  XII 
Science  average  for  9  of  10  criteria,  was  apparently  not  tested  for 
significance  although  the  researcher  intended  to  study,  among  other 
implications  from  past  studies,  that  "the  use  of  multiple  correlation 
promised  a  means  of  selecting  the  best  combination  of  variables  for 
predicting  each  criterion"  (Zurowsky,  1959>  P «46).  The  improvement,  as 
indicated  in  Table  VII,  ranged  from  -.004  to  .178  with  a  median  improve¬ 
ment  in  correlation  of  .050.  The  generally  slight  improvement  in 
correlation  from  using  even  all  the  predictor  variables,  as  indicated 
in  Table  VII,  would  seem  to  provide  some  reason  to  doubt  the  implication 
above . 

In  comparing  a  battery  of  Grade  XII  Departmentals  with  a  battery 
of  SCAT  subtests  and  Co-operative  English  tests  combined,  Zurowsky  (1959) 
found  that  the  Grade  XII  scores  were  the  more  effective  predictors  of 
university  marks  for  nine  individual  courses  and  over-all  average 
(Table  VII ).  There  was,  generally,  only  slight  improvement  in  the 
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predictive  ability  of  the  entire  battery  of  Grade  IX  and  Grade  XII 
Departmentals ,  SCAT  and  Co-operative  English  tests  as  compared  to  the 
predictive  ability  of  a  battery  of  five  Grade  XII  Departmentals  alone, 
although,  again,  no  results  of  testing  for  significance  of  differences 
were  included  in  the  report. 

Zurowsky  analyzed  the  contributions  of  each  of  the  predictor 
variables  in  the  Grade  XII  battery  by  comparing  their  beta  weights  in 
each  multiple  regression  equation.  He  concluded  that  the  Grade  XII 
Science  average  consistently  contributed  more  weight  than  the  other 
Grade  XII  subjects  in  predicting  first-year  university  success.  The 
Grade  XII  Foreign  Language  mark  did  not  contribute  to  the  prediction 
batteries  (Zurowsky,  1959,  P-  93 )• 

Clarke  (195&)  reported  two  other  studies  that  had  been  conducted 
at  the  University  of  Alberta.  Fitzpatrick  studied  253  freshmen  enrolled 
in  the  Engineering  faculty  in  1954-55.  He  found  that  the  best  predictor 
of  university  average  was  the  Departmental  math-science  average  which 
yielded  a  correlation  of  O.67.  The  ACE  Psychological  Examination 
yielded  a  correlation  of  only  0.23  with  university  average.  Fair 
studied  one  hundred  Arts  freshmen  who  entered  the  university  in  1953* 

He  found  that  the  correlation  of  the  Departmental  average  with  first - 
year  university  average  was  0.64j  the  corresponding  correlation  for  t:ie 
ACE  Psychological  Examinations  was  0.40.  The  relative  superiority  c. 
Departmentals  over  the  ACE  was  maintained  in  predicting  the  university 
third  year  average.  The  correlation  coefficient  using  the  Departmental 
0.41  as  compared  to  ACE’s  0.31,  but  the  best  predictor  of 


average  was 


srtf  t  bsi  .  :  *89*  :  ::  svJtd  .  -  C  :  *?/:.:  .al  .j'-x  cht  q©C[ 

•  • 

•.  I  '■ 

.  ch,  ...  •  .t.!:  :.  ms./ 

. 

.  '  - 

■ ,  -  '  •  ■  X  - 


. 

!  '..6',  cf  Jj  a 

f  stfu  X’.j  0 

w  ,r:  >  i  .:r  e; 

• 

t 

:/.  ■  c?  :,c-'X  i;  :: 

larid1  ijod’*.:  "9i 

•  d  •  ;  I  * 

9  .  .  \'L  nl  vd\ij - -- 

i  r  ios-  ■  d  he  ■/  s  .  ..  /,  ^ ...  ■.  t .  d 

-  -9-V, 

.0  .... 

.  _  '  ,  .  \  .  - 

-•I'.  Z9Ve  drt  ■  d  ■  .  e 

■■  ■-  , 

...  ■■  .  , 

■ 

'  .  .  1  .'.t  "  3:. 


28 


third  year  average  was  the  first  year  average  which  yielded  a  coefficient 
of  O.69  (Clarke,  1958). 

A  recent  study  by  Mack  (1963)  of  University  of  Alberta  freshmen 
confirmed  that  the  Grade  XII  Departmentals  correlate  more  highly  with 
university  freshman  average  than  do  either  the  ACE  Psychological  Exam¬ 
inations  or  the  Co-operative  English  tests.  His  results,  related  in 
part  in  Table  VIII,  were  computed  in  terns  of  the  faculty  in  which  a 
student  enrolled.  Such  differential  criteria  allowed  more  precise  prob¬ 
ability  tables  to  be  drawn  up  in  the  second  part  of  the  study  (Mack, 

1963 ,  p.  108).  The  Grade  XII  average  correlated  most  highly  with  marks 
of  Faculty  of  Science  students  (r  =  *715)  and  lowest  with  Education 
students  (r  =  .450),  varying  from  a  good  predictor  in  the  first  instance 
to  a  mediocre  predictor  in  the  second.  Mack  also  grouped  the  high 
school  mean  scores  into  units  of  five  in  order  to  present  a  concise 
table  of  probabilities  of  success  in  each  faculty.  Such  a  technique, 
developed  by  Eells  (1961-a),  would  appear  to  be  a  valuable  form  of 
presentation  of  predictive  data  for  guidance  purposes.  Mack's  suggestion 
that  his  tables  could  be  used  by  high  school  students  with  their 
counsellors  would  seem  to  be  limited  by  the  nature  of  the  data.  Depart¬ 
mental  marks,  which  are  not  availaole  until  alter  the  school  term  has 

ended. 


Implications  Arising  from  Alberta  Studies 

1.  Of  the  many  types  of  predictors  of  university  success 
considered  in  Alberta  to  date,  the  most  valuaole  one  has  been  the  resulto 
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of  Grade  XII  Departmental  Examinations .  As  shown  in  Table  IX,  Grade  XII 
marks  have  been  found  to  be  superior  to  Grade  IX  results,  standard 
achievement  test  scores,  and  scholastic  aptitude  tests. 

2.  In  studies  of  multiple  prediction,  the  Grade  XII  battery  has 
oeen  found  to  be  superior  to  batteries  of  any  other  predictor  variables. 
Very  little  improvement  resulted  from  adding  scholastic  aptitude  test 
scores  or  results  from  standard  achievement  tests  to  the  Grade  XII 
battery.  Improvement  in  the  prediction  of  success  at  the  University  of 
Alberta  would  appear  to  be  found  through  improved  methods  of  measuring 
achievement  in  Grade  XII. 

3*  Either  the  Grade  XII  average  or  Grade  XII  course  marks  were 
used  in  past  studies.  There  was  some  indication  that  the  use  of  course 
marks  allowed  the  best  discriminators,  for  example,  the  science  average, 
to  be  given  more  weighting  than  poorer  predictors.  There  appeared  to 
be  a  need  to  test  the  relative  merits  of  Grade  XII  average  as  compared 
to  Grade  XII  course  marks  in  their  ability  to  predict  university  success. 

4.  Recent  studies  in  Alberta  considered  differential  criterion 
groups  at  the  university.  Such  differentiation  appeared  to  offer  the 
promise  of  improved  predictive  accuracy  as  compared  to  considering 
students  as  one  group. 

5.  As  valid  predictors  are  found,  a  problem  of  communicating 
the  results  to  high  school  students  and  counsellors  has  developed.  The 
techniques  employed  by  Mack  (1963)  of  using  an  expectancy  chart  would 
seem  to  be  worthwhile.  There  was  some  indication  that  the  regression 
equation  appeared  to  be  too  complex  a  technique  j.or  current  general 
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school  usage  even  though  the  graphic  interpretation  of  multiple  predic¬ 
tion  equation  scores  proposed  by  Black  (i960)  offers  a  better  interpret¬ 
ative  technique  for  multiple -variable  predictive  data* 

High  School  Achievement  and  University  Success 

Since  one  measure  of  high  school  achievement,  the  Grade  XII 
Department als,  has  been  found  to  be  a  better  predictor  of  university 
success  in  Alberta  than  standard  achievement  or  scholastic  aptitude  tests, 
it  appeared  to  be  worthwhile  to  investigate  the  predictive  validity  of 
other  measures  of  high  school  achievement*  Studies  in  Canada  and  the 
United  States  have  been  concerned  with  such  predictor  variables  as  rank- 
in-class,  teachers'  ratings  on  character  traits,  and  counsellors' 
predictions,  and  with  improving  the  predictive  value  of  present 
measures. 

In  his  review  of  predictive  studies,  Henry  (1950)  suggested  that 
there  is  a  ceiling  on  the  correlation  between  high  school  marks  and 
university  average  because  of  the  nature  of  the  high  school  marko  lie 
explained  that  even  if  several  students  achieved  the  same  mark  at  the 
same  high  school,  or  on  the  same  set  of  examinations,  there  may  be  great 
differences  among  the  ways  in  which  this  mark  was  achieved,  and  hence, 
the  students'  chances  for  future  scholastic  success*  One  student  might 
have  only  mediocre  mental  ability  out  through  efficient  stucy  habios  and 
many  hours  of  work  does  well  in  school  work0  Another  student  might  be 
much  more  intelligent  but  is  inefficient  and  disinterested  in  studying. 

A  third  student  might  be  both  quite  intelligent  and  a  reasonably 
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conscientious  worker .  Consideration  of  the  mark  alone  probably  ignores 
much  of  the  relationship  between  scholastic  ability  and  work  habits--a 
relationship  which  migh  well  determine  the  chances  of  later  success. 

Attempts  to  overcome  shortcomings  in  the  high  school  marks  were 
made  in  a  number  of  ways.  Williams  and  Knecht  (1962)  postulated  that 
since  the  teacher  and  student  were  closely  acquainted  for  a  comparatively 
long  period  of  time,  a  rating  by  the  teacher  might  consider  many  factors 
that  are  relevant  in  prediction  problems.  In  their  study,  teachers  were 
asked  to  rate  each  of  their  students  on  "likability" .  The  correlation 
between  their  rating  and  the  California  Test  of  Mental  Maturity  was 
fairly  high  (r  =  .53)  but  the  correlation  between  rating  and  high  school 
grade  point  average  was  higher  (r  =  *71)*  Thus,  the  rating  of  even  a 
non-intellective  trait  corresponded  well  with  scholastic  success  and 
scholastic  aptitude. 

9 

Black’s  study  (1958)  in  Alberta  made  a  similar  finding  about 
teachers’  ratings.  In  both  Grade  IX  and  Grade  XII,  a  rating  is  made  by 
teachers  for  each  student  in  each  subject  area  prior  to  the  Departmental 
Examination.  These  reports  are  collected  together  for  the  students  of 
each  school  in  the  form  of  a  Principal's  Confidential  Report.  For  a 
sample  of  about  six  hundred  Grade  IX  students,  the  median  correlation 
between  the  teachers'  ratings  and  Departmental  marks  was  O.65.  It  was 
found,  however,  that  SCAT  scores  correlated  higher  with  the  Departmental 
mark  (median  r  =  .80).  Thus,  in  Grade  IX,  teachers’  ratings  were  of 
value  in  predicting  subsequent  Departmental  marks  but  were  second  in 


size  to  the  SCAT  scores. 
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A  study  by  Bou  and  Stovell  (1950)  intended  to  find  the  predictive 
value  of  teacher -as signed  high  school  marks.  A  regression  equation  was 
computed  for  the  total  group  of  students  predicting  university  success 
from  high  school  marks.  On  the  rationale  that  the  number  of  students 
with  whom  a  teacher  was  associated  would  determine  the  validity  of  the 
assigned  marks,  the  high  schools  were  divided  into  two  groups --  'small 
high  schools"  with  less  than  five  hundred  students  and  "large  high 
schools"  with  five  hundred  or  more  students.  A  comparison  was  made 
between  the  two  sizes  of  high  schools  on  the  average  difference  between 
predicted  score ,  arising  from  an  application  of  the  regression  equation 
to  teachers'  marks ,  and  the  actual  score  attained  at  university.  The 
large  high  schools  had  a  smaller  average  difference  between  these  two 
scores  than  the  small  schools.  The  predicted  value  for  students  of  small 
schools  was  generally  an  overestimation.  It  should  be  noted  that  the 
differences  between  the  two  groups  was  somewhat  spurious  in  that  each  of 
the  sma.ll  high  schools  had,  of  course,  fewer  members  in  the  freshman  class 
with  the  result  that  a  "miss"  on  just  one  or  two  students  would  have  a 
sizable  effect  on  the  mean.  It  would  have  been  interesting,  too,  to  have 
a  further  breakdown  into  groups  of  schools.  Size  of  school  would  seem  to 
be  an  important  factor  to  consider  in  the  use  of  teachers'  ratings. 

Prescott  and  Garret son  (1940)  found  that  correlations  between 
university  freshman  success  and  teachers 1  ratings  on  student  character¬ 
istics  were  greater  than  0.60  for  such  characteristics  as  habit a  of 
studiousness,  probable  success  at  university,  persistence,  and  aoility 

The  teachers'  ratings  of  probable  success  at  university 
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correctly  predicted  79  per  cent  of  those  with  passing  grades  and  69  per 
cent  of  failing  students  at  university.  These  findings  were,  however, 
based  on  three  hundred  students  from  one  high  school  so  that  little 
generalization  of  the  findings  could  be  made. 

Robertson  (i960)  conducted  a  study  to  determine  the  relative  merits 
of  a  counsellor’s  and  a  student’s  prediction  of  college  success.  At  a 
pre-college  program,  prospective  freshmen  were  asked  to  predict  their 
success  at  university  (pre -estimate) .  Following  two  days  of  testing,  each 
student  met  with  a  counsellor  who  interpreted  the  test  results.  Each 
student  made  a  second  prediction  (post -estimate)  and  the  counsellor  made 
his  own  prediction.  Using  the  first  semester  grades  as  the  criterion, 
only  the  counsellor's  estimate  was  relatively  valuable  (r  =  O.50).  It  was 
found  that  students  tended  to  overestimate  their  abilities;  the  counsellor 
overestimated  for  the  low-achieving  students.  Although  these  estimates 
were  of  limited  value  individually,  Robinson  suggested  that  they  might  con¬ 
tribute  to  a  battery  of  high  school  grades  and  intelligence  scores.  Such 
a  specialized  program  would  seem  to  be  of  limited  practical  utility, 
especially  if  correlations  of  prediction  with  university  success  are  low, 
because  of  the  expense  and  proximity  in  time  to  the  start  of  university 

program. 

An  Ontario  study  of  the  entire  population  of  Grade  XIII  graduates 
provisions  for  the  evaluation  of  teachers  ratings  (Jackson  and 
Fleming,  1957).  A  staff  questionnaire,  completed  by  each  student's 
teachers,  included  a  five-point  rating  sclae  regarding  such  factors  as 
leadership,  industry,  and  chances  of  success  at  university.  An 
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acknowledged  weakness  was  "the  variability  in  each  rater's  interpretations 
of  the  terms.  Of  all  the  Grade  XII  graduates ,  some  fifty -three  per  cent 
were  rated  as  higher  than  average  regarding  chance  of  university  success. 

A  follow-up  study  showed  that  seventy-three  per  cent  of  these  students 
actually  enrolled  in  university.  To  date,  no  reports  have  been  issued  on 
actual  performance  in  university  of  this  group. 

Douglas's  study  (Garrett,  19^9)  at  the  University  of  Oregon  in¬ 
volved  the  use  of  the  "Principal's  Quartile  Rating"  of  scholarship. 
Although  this  rating  correlated  only  moderately  well  with  university 
success  (r  =  .48),  it  was  second  only  to  actual  high  school  average 
(r  =  O.56).  By  combining  the  rating  with  rank-in-class,  a  correlation  of 
0.50  with  university  freshman  marks  was  derived.  Adding  the  rating  to 
the  high  school  average  did  little  to  improve  the  predictive  power. 

Pherson  (1958)  conducted  a  study  in  Portland,  Oregon  to  investi¬ 
gate  the  success  with  which  high  school  teachers  and  counsellors  predicted 
university  success.  One  month  before  high  school  graduation,  the  teachers 
and  counsellors  rated  each  student  on  personality  traits  and  general 
ability  to  do  university  work.  The  predictive  success  of  these  ratings 
for  some  two  hundred  randomly-chosen  freshmen  was  compared  to  the  pre¬ 
dictive  success  of  such  variables  as  high  school  grades  and  the  ACE 
Psychological  Examination.  The  ratings  on  personality  traits  did  not 
prove  to  be  consistently  successful.  The  ratings  on  general  aorlity 
correlated  with  college  grades  to  the  same  degree  that  the  ACn  did.  ^^-ch 
of  these  variables  was  less  successful  than  high  school  grades  which  had 
a  correlation  coefficient  of  0.65* 
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McGill  University ,  concerned  with  the  unreliability  and  unknown 
validity  of  entrance  marks,  has  made  use  of  confidential  reports  from 
each  applicant's  school  (Matthews,  1957)*  No  statistical  study  has  been 
conducted  regarding  the  success  of  this  practice.  Two  immediate  problems 
of  the  scheme  were  the  varying  standards  from  school  to  school  and  the 
limitations  on  counselling,  arising  from  the  confidential  nature  of  the 
rating. 

Predictive  studies  have  been  limited  by  the  unknown  reliability 
and  validity  inherent  in  instructor's  marks.  A  study  by  Carter  (1953) 
investigated  the  hypothesis  that  teachers '  marks  are  affected  by  such  non¬ 
intellect  ive  variables  as  subjective  preference  of  one  group  of  students 
as  a  result  of  teacher  identification  with  that  group.  He  suggested  that 
the  sex  of  the  student  as  compared  to  the  sex  of  the  teacher  might  be  such 
a  factor.  In  his  study,  which  also  considered  the  effect  of  pupil  differ¬ 
ences  in  socio-economic  status  and  personality,  some  two  hundred  high 
school  students  were  selected.  Each  student  was  taught  and  tested  by  one 
of  six  experienced  teachers  in  an  algebra  course.  The  sexes  were  evenly 
represented  in  both  student  and  teacher  groups.  The  teacher-assigned 
marks  were  compared  to  scores  on  the  algebra  test  Ircm  the  Calixornia 
Achievement  Test  battery.  There  was  a  high  correlation  between  the  two 
sets  of  marks  but  it  wTas  found  that,  regardless  of  whether  the  teacher 
was  male  or  female,  boys  were  penalized  in  the  ratings.  Negative  non- 
intellective  factors  tended  to  be  more  influential  with  males  than  with 

females . 

The  composition  of  instructor’s  marks  being  somewhat  different  for 
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female  students  than  for  males  was  suggested  as  one  cause  for  the 
apparent  predictive  superiority  of  marks  for  female  students  that  was 
found  by  several  researchers  (Seashore,  1962;  Klugh,  et.  al. ,  1959; 
Abelson,  1952)*  The  study  by  Klugh  which  considered  the  correlations 
between  high  school  and  college  grade  point  averages,  found  that  the 
correlation  for  the  female  group  was  significantly  greater  than  that  of 
the  male  group  in  both  an  original  study  (  rf  =.65;  rm  =.58)  and  a 
cross-validational  study  (r^  =  .68;  rm  _  °53 )  • 

Despite  their  better  correlation  with  university  grades,  the 
marks  of  female  students  were  generally  found  to  be  less  variable  than 
those  of  male  students.  Abelson  (1952)  combined  this  finding  with  the 
finding  that  marks  for  females  had  greater  predictive  success  to  investi¬ 
gate  the  reality  of  the  difference.  Using  a  statistic  termed  the 
"standard  error  of  prediction"  which  represented  the  difference  between 
predicted  and  observed  college  scores  (similar  to  standard  error  of 
estimate),  Abelson  found  a  significant  difference  in  all  studies  includ¬ 
ing  those  for  which  the  correlation  coefficients  for  female  students  were 
not  larger  than  those  for  males.  Since  the  standard  error  of  prediction 
is  dependent  on  the  standard  deviation  of  college  scores  and  the  cor¬ 
relation  between  predictor  and  college  grades,  it  would  appear  to  be  an 
appropriate  measure  of  sex  differences  in  predictor  studies. 

Seashore’s  (1962)  review  found  that  approximately  80  per  cent  of 
the  predictive  studies  showed  that  the  correlation  coefficient  was  larger 
for  female  students  than  for  males;  a  similar  proportion  showed  that 
marks  for  female  students  were  less  variable  than  those  of  males.  In 
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attempting  to  explain  this  apparent  sex  difference.  Seashore  raised 
several  questions  including  the  possibility,  mentioned  above,  that  more 
extraneous  r-reducing  variables  entered  the  teacher's  judgment  in  giving 
grades  to  men.  He  suggested  that  a  male  group  is  more  likely  to  have  a 
few  "maverick"  performers  who  act  in  a  virtually  unpredictable  way. 

There  was  a  common  belief,  still  not  strongly  supported  by  research 
studies ,  that  more  boys  than  girls  tend  to  be  under-achievers  in  high 
school.  Coupled  with  this  difference  is  the  difference  in  motivation 
for  males  between  high  school  and  university.  In  addition,  oollege  men 
tend  to  have  more  outside  interests  than  college  women.  Such  outside 
interests  have  a  generally  unpredictable  effect  on  college  grades.  The 
difference  between  the  variability  and  predictive  success  of  female 
students’  marks  as  compared  to  those  of  male  students  has  been  fairly 
well  founded  but  not  well  explained. 

The  use  of  teacher’s  grades  offered  the  obvious  problem  of  taking 
into  account  the  variations  among  schools  and  educational  programs. 
Attempts  have  been  made  to  compensate  for  differences  between  ratings 
since  it  is  generally  felt  that  "the  best  available  evidence  of  a 
student’s  academic  capabilities  and  achievements  consists  of  the  judg¬ 
ments  made  by  the  teachers  and  professors  who  have  worked  with  him  over  a 
period  of  years"  (Bloom  and  Peters,  1961,  p.  3) 

One  such  attempt  was  made  by  Bou  and  Stovell  (1950)  who  found 
that  more  precise  predictions  could  be  made  by  difterentiating  students 
into  two  groups  on  the  basis  of  the  size  of  high  school  from  which  they 


graduated. 
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Yale  and  Princeton  Universities  have  attempted  to  improve  the 
prediction  from  high  school  grades  by  yearly  codification  for  each  school 
regarding  the  success  of  its  graduates.  Respectable  correlations 
(r  =  O.76)  were  found  with  marks  from  schools  which  sent  many  graduates 
but  not  with  those  of  schools  which  sent  few  graduates  (Bloom  and  Peters, 

1961,  p.  8). 

British  studies  have  used  a  "transmutation  of  marks"  that  takes  in¬ 
to  account  the  difference  in  intelligence  level  of  various  student  popu¬ 
lations  (Bloom  and  Peters,  1961,  p«  lo).  Teachers’  marks  were  scaled  on 
the  basis  of  the  school  mean  and  standard  deviation  of  scores  made  on  a 
common  intelligence  test.  The  scaled  score  became  the  best  single  pre¬ 
dictor  of  university  success. 

A  further  complexity,  not  yet  considered  in  any  published  Alberta 
studies  occurs  when  the  criterion  scores  originate  in  more  than  one 
university  or  other  post -secondary  school  institution.  A  local  example 
would  be  to  predict,  with  scores  from  Alberta  high  schools,  the  students’ 
chances  of  success  at  either  branch  of  the  University  of  Alberta,  at 
junior  colleges,  and  at  technological  institutes.  Bloom  and  Peters 
(1961,  p.  49)  arrived  at  a  method  of  scaling  high  school  and  college 
scores  in  such  a  way  that  scores  which  yielded  a  maximum  correlation  of 
0.51  with  university  grades  were  corrected  to  yield  a  correlation  of  O.77. 
Briefly,  the  correcting  process  consisted  of  equating  the  college  marks 
from  one  institution  to  another,  from  which  an  adjusted  mark  was  found  for 
each  high  school.  The  adjusted  mark  was  correlated  with  the  actual  college 
mark,  giving  a  regression  equation  for  each  college,  ihe  reoultin^  values 
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were  used  to  adjust  the  student's  college  mark.  The  same  adjustments 
were  used  with  a  following  year's  class  and  the  correlation  remained 
relatively  high  (r  =  O.72).  Despite  the  time-consuming  manipulations  and 
complexity ,  this  approach  seemed  to  suggest  a  means  of  answering  a 
problem  soon  to  be  faced  in  Alberta. 

Another  recent  statistical  development  which  may  improve  the  pre¬ 
diction  of  college  success  was  the  technique  of  multiple  differential 
grade  prediction.  This  technique  allows  the  researcher  to  choose  the  best 
combination  from  a  large  pool  of  predictive  variables  for  each  college 
area.  There  have  been  differences  of  opinion  as  to  the  value  and  wisdom 
of  using  such  a  technique. 

Differentiating  among  the  criteria  has  met  with  some  success „  To 
test  the  varying  efficiency  of  predictors ,  researchers  at  Yale  computed 
the  correlation  between  SAT  Verbal  scores  and  freshman  marks  in  several 
subjects  (Bloom  and  Peters,  1961;  p.  28).  The  SAT  score  was  a  fairly  good 
predictor  of  English -history  (r  =  0.49)  and  physics  marks  (r  =  0.40)  but 
a  poor  predictor  of  Engineering  drawing.  Zurowsky  (1959)j  as  mentioned 
above,  found  that  although  the  high  school  science  mark  was  a  valuable 
predictor  for  each  of  the  university  courses  considered,  the  contributions 
of  the  ether  high  school  suojects  varied  among  the  criteria.  Macx  (li’oj) 
found  that  the  predictive  value  of  the  high  school  average  varied  consider¬ 
ably  among  the  faculties. 

Travers  (1958)  felt  that  the  multiple  prediction  method  was  often 
used  in  a  "shot-gun"  approach,  whereby  the  researcher  grasps  at  anything 
that  has  apparent  "predictive  validity''  without  the  beneiit  of  a 
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theoretical  iramework.  bince  some  of  the  correlation  may  be  due  to 
chance  factors  arising  from  the  particular  sample  group,  the  researcher 
may  be  misled  into  believing  he  has  found  a  valuable  predictor.  Travers 
recounted  that  many  such  predictors  have  "shrunk"  to  the  point  of  being 
worthless  in  cross -validational  studies  in  which  the  irrelevant  chance 
factors  were  no  longer  present  (Travers,  1958,  p.  300).  Conversely,  the 
University  of  Washington  group  under  Dvorak  and  Horst,  have  taken  the 
position  that  use  should  be  made  of  all  variables  readily  available  to 
the  admitting  officers  of  the  university  even  though  its  actual  contri¬ 
bution  to  the  prediction  is  slight.  Such  a  position  is  premised  on  the 
availability  of  computer  facilities. 

One  multiple  prediction  technique  is  the  Horst  iteration  method 
which  "selected  only  those  predictor  variables  in  an  assigned  weighting 
for  each  so  as  to  produce  the  largest  multiple  correlation  coefficient 
possible  between  the  criterion  and  the  predictor  variables"  (Black,  i960, 
p.  4l).  In  Black’s  study  of  1956  freshmen,  it  was  found  that  the  in¬ 
creases  in  correlation  coefficients  through  use  of  a  combination  of 
predictors  instead  of  the  single  best  predictor  ranged  from  0.00  to 
0.14,  with  a  median  increase  of  O.03.  Ho  tests  of  significance  of  the 
increases  were  reported  but  one  could  conclude  that  the  multiple 
correlation  coefficient  tended  to  be  consistently,  but  modestly,  greater 
than  the  zero -order  correlation  coefficient  for  the  best  predictor. 

The  study  of  Klugh  and  Bierley  (1959)  investigated  the  improvement 
in  predicting  university  grade  point  average  by  two  variables,  high 
school  average  and  SCAT  scores. 


instead  of  the  high  school  average  alone. 
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As  indicated  on  TaDle  X,  the  multiple  correlation  method  did  result  in 
an  increase  for  both  men  and  women  students  in  studies  a  year  apart. 

The  increase  in  each  case  was  found  to  be  significant. 

Not  all  researchers  agree  that  multiple  predictive  grade  correla¬ 
tion  studies  are  worth  the  extra  effort.  Eells  (1961)  found  that 
combining  standardized  test  scores  together  in  differential  batteries 
for  each  of  four  curricula  areas  in  university  resulted  in  little  im¬ 
provement  in  predictive  accuracy.  It  appeared  that  accurate  results 
could  be  achieved  through  the  use  of  one  battery  for  all  curricula  areas. 
Since  high  school  records  were  not  considered  in  the  battery ,  no  sound 
conclusions  could  be  made  about  the  value  of  differentiating  among  the 
criteria  in  studies  employing  high  school  marks. 

The  complexity  of  factors  affecting  the  predictive  accuracy  of 
high  school  marks  was  illustrated  by  Fleming's  comment,  that: 

...in  theory,  it  should  be  possible  to  predict  with  a  high 
degree  of  accuracy  from  the  Grade  XIII  average  alone  what 
university  average  will  be  obtained  by  a  girl  of  17  or  18  who 
does  some  of  her  Grade  XIII  work  in  Grade  XII,  who  writes  all 
the  rest  of  her  Grade  XIII  papers  in  the  succeeding  year  without 
failure,  who  comes  from  a  school  with  a  favourable  environment 
in  a  community  of  high  economic  level,  who  lives  at  home  while 
attending  university,  and  who  enters  an  Honours  Course  (Clarke, 

1958,  P.  36). 

Perhaps  the  single  most  important  feature  in  limiting  the  effect¬ 
iveness  of  various  predictors  alone  and  in  comoination  lies  in  the 
reliability  of  criterion  scores,  namely,  university  grades.  This  aspect 
of  the  problem  to  a  largo  extent  has  been  ignored  pro^aoly  because  of 
the  difficulty  in  obtaining  such  information  and  the  embarrassment 
resulting  from  it.  The  English  "transmutation"  of  criterion  scores  cited 
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TABLE  X 

ZERO -ORDER  AND  MULTIPLE  CORRELATION  COEFFICIENTS 
BETWEEN  SCAT  SCORES,  HIGH  SCHOOL  AVERAGE  AND 
UNIVERSITY  FRESHMAN  ACHIEVEMENT 
(After  Klugh  and  Bierley,  1959) 


CORRELATION  BETWEEN  COLLEGE  AVERAGE  AND 


GROUP 

N 

A 

SCAT1 

B 

H.S.  AVERAGE 

MULTIPLE 

A  +  B 

1956  MEN 

106 

.54 

»58 

.67 

WOMEN 

97 

.51 

.65 

.68 

1957  MEN 

125 

•59 

•53 

.66 

WOMEN 

102 

.67 

.68 

0 

— -3 

00 

L  i. 
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oy  Bloom  and  Peters  (1961,  p.  6)  and  referred  to  earlier  recognizes  this 
pro  Diem  in  part  but  it  has  been  largely  ignored  in  the  North  American 
studies* 

Summary 

A  consistent  finding  in  past  studies  was  that  the  best  predictor 
of  university  freshman  success  was  some  measure  of  high  school  achieve¬ 
ment  (Bloom  and  Peters,  I96I;  Garrett,  19^9;  Henry,  I95O;  and  Travers 
19^9)*  High  school  marks  were  found  to  be  more  valid  as  predictors  than 
such  other  variables  as  standardized  achievement  tests,  scholastic  apti¬ 
tude  or  intelligence  tests,  and  existing  measures  of  persistence  and 
motivation.  The  superiority  of  high  school  marks  in  predicting  first- 
year  success  at  the  University  of  Alberta  has  been  confirmed  by  many 
studies  (Black,  1959,  i960;  Clarke,  1958;  Evenson  and  Smith,  1958; 
Mack,  1963;  and  Zurowsky,  1959).  The  measure  of  high  school  achieve¬ 
ment  considered  in  past  Alberta  studies  was  the  Grade  XII  Departmental 
Examination  (Table  IX). 

The  best  predictor  of  marks  in  the  graduating  year  at  the 
University  of  Alberta  have  been  found  to  be  the  university  average  of 
previous  years  (Evenson  and  Smith,  1958)* 

The  uredictive  accuracy  of  high  school  marks  was  found  to  oe 
influenced  by  the  size  of  high  school  at  which  the  marks  were  assigned 
(Bloom  and  Peters,  196I;  Bou  and  Stovell,  1950).  Marks  0f  students 
from  large  high  schools,  where  the  comparison  groups  were  mere  normally 
distributed,  produced  greater  correlations  with  university  achievement 
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■than  marxs  of  students  from  small  high  schools  produced. 

The  technique  of  multiple  differential  grade  prediction  was  found 
to  provide  a  method  of  improving  the  predictive  efficiency  of  presently- 
available  variables  (Black,  i960;  Horst,  1954;  Mack,  1963;  and 
Zurowsky,  1959)*  This  approach  assumes  both  that  predictor  variables  will 
vary  in  their  correlation  with  a  criterion  and  that  this  relative  value 
of  predictor  variables  will  change  from  one  criterion  to  another.  Each 
of  the  Grade  XII  Departmental  Examinations  has  been  found  to  have  a 
correlation  with  university  freshman  average.  The  multiple  correlation 
between  a  battery  composed  of  the  Departmental  Examinations  and  university 
average  was  found  to  be  greater  than  the  zero -order  correlation  between 
the  single  best  predictor  of  the  Departmentals  and  university  average 
(Table  VII ).  Improved  predictions  of  university  success  were  achieved 
by  differentiating  among  the  criteria,  generally  on  the  basis  of 
university  faculty  or  individual  course. 

In  addition  to  the  graduating  high  school  size  and  the  faculty 
entered  at  university,  the  sex  of  the  student  was  found  to  have  an 
effect  on  the  predictive  accuracy  of  high  school  marks.  The  marks  for 
female  students  were  found  to  be  predictively  superior  to  the  marks  of 
male  students  (Abelson,  1952;  Klugh  et.  al. ,  1959;  and  Seashore,  1962). 
In  addition,  there  was  some  indication  that  male  stuuents  were  penalized 
by  teacher-assigned  marks  (Carter,  1953)* 

Several  studies  (Garrett,  1949;  Jackson  and  Fleming,  1957; 

Pherson,  1958;  and  Prescott  and  Garretson,  1940)  reported  that  a 

found  to  be  a  valuable  predictor  of  future  academic 
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success  because  it  contains  some  information  not  considered  in  a  test 
score.  Henry  (1950)  suggested  that  the  teacher's  rating  would  consider 
the  interplay  of  ability  level  and  work  habits  more  than  the  test  soore 
alone  would.  The  value  of  teachers'  ratings  were  attributed  to  the 
general  teacher -student  association  in  past  learning  situations  and,  as 
such,  were  relevant  predictors  of  future  learning  (Williams  and  Knecht, 
1962;  Bloom  and  Peters,  1961). 


S'-  i  ..  I  .  ■  .•  v 

.  . 


CHAPTER  III 


EXPERIMENTAL  DESIGN 


Hypotheses 

The  present  study  investigated  the  problem  of  predicting  success 
at  the  University  of  Alberta,  Edmonton.  Research  findings  indicated 
that  the  factors  of  size  of  high  school,  faculty  in  which  a  student 
enrolled,  and  sex  of  the  student  would  affect  the  accuracy  of  predictors. 
Past  studies  also  indicated  that  teachers '  ratings  of  high  school  per¬ 
formance  were  valuable  predictors  of  university  freshman  success. 

1.  The  predictive  accuracy  of  high  school  marks,  as  indicated  by 
their  correlation  with  university  average,  is  affected  by  the  size  of 
high  school  at  which  the  marks  were  assigned.  Marks  of  students  from 
larger  high  schools  would  produce  greater  correlations  with  university 
average  than  would  marks  of  students  from  smaller  high  schools  (Bloom 
and  Peters,  1961.:  Bou  and  Stovell,  1950). 

2.  The  value  of  a  predictor  variable  or  ideal  composition  of  a 
predictor  battery  varies  from  one  faculty  group  to  another.  The  relative 
value  of  a  variable  in  a  battery  varies  according  to  the  faculty  in  which 
the  student  enrols  (Black,  i960  Horst,  195^+  j  Mack,  1963;  and 
Zurowsky ,  1959)* 

3.  High  school  and  university  scores  and  the  correlation  between 
them  differ  for  male  and  female  groups  01  students.  Tne  correlation 
between  high  school  marks  and  university  average  is  greater  i or  female 
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students  (Abelson,  1952;  Klugh  et.  al. ,  1959;  and  Seashore,  1962). 
Predictions  of  marks  for  male  students  are  more  likely  to  be  under¬ 
estimations  of  the  actual  mark  than  predictions  for  female  students 
(Carter,  1953). 

k.  The  use  of  Grade  XII  Principals’  Ratings  would  lead  to  as 
great  a  correlation  with  university  first -year  average  as  would  the  use 
of  Grade  XII  Departmental  Examinations.  Despite  their  unknown  reliability, 
the  teacher's  rating  was  found  to  be  a  valuable  predictor  of  future 
academic  success  because  of  its  basis  on  a  relatively  long-term  associ¬ 
ation  between  student  and  teacher  in  learning  experiences  (Bloom  and 
Peters,  196I;  Garrett,  1949;  Henry,  1950-  Jackson  and  Fleming,  1957i 
Pherson,  1958;  Prescott  and  Garretson,  1940;  and  Williams  and  Knecht, 
1962). 

The  Sample 

The  sample  consisted  of  members  of  the  1962-63  freshman  class  at 
the  University  of  Alberta,  Edmonton,  who  had  enrolled  in  the  faculties  of 
Arts,  Education,  Engineering,  and  Science.  Only  those  freshmen  were 
selected  who  had  completed  the  Grade  XII  course  of  studies  in  Alberta  in 
June,  1962,  and  for  whom  all  Principals’  Ratings  were  available.  The 
sample  consisted  of  1017  freshmen,  457  of  whom  were  female  and  560  of 
whom  were  male. 

The  Procedure 

A  data  sheet  was  made  for  each  freshman  in  the  sample,  from  the 
Registrar’s  Office,  University  of  Alberta,  such  data  as  final  course  marks 
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in  first-year  subjects,  university  first-year  average,  sex  of  student, 
and  faculty  entered  were  recorded  on  the  form.  The  Grade  XII  Depart¬ 
mental  Examination  results ,  the  name  of  graduating  high  school,  the 
number  of  teachers  in  the  graduating  high  school,  and  the  ratings  given 
in  the  Principals*  Confidential  Report  were  gathered  for  each  student 
from  the  Examination  Branch,  Department  of  Education. 

There  were  a  minimum  of  six  Grade  XII  high  school  marks  for  each 
student.  The  marks  in  the  sciences,  two  or  three  of  Physics  30, 

Chemistry  30,  and  Biology  32,  were  combined  by  recording  the  mean  score 
as  Science  Average  following  the  procedure  of  Zurcwsky  (1959)*  Each 
student  in  the  Faculty  of  Engineering,  as  well  as  many  others  in  the 
sample,  had  high  school  marks  in  Mathematics  31  as  well  as  in  Mathematics 
30 o  The  mean  was  derived  for  these  students  and  recorded  as  the 
Mathematics  Average.  For  students  who  had  marks  in  more  than  one  Grade 
XII  foreign  language,  usually  French  and  Latin,  the  marks  were  averaged 
and  recorded  under  Foreign  Language.  In  addition  to  the  areas  of  science, 
mathematics,  and  foreign  language,  there  were  marks  for  each  student  in 
Social  Studies  30  and  English  30  (Language  30  and  Literature  30).  Any 
student  for  whom  both  Principals  *  Ratings  and  Departmental  Examination 
results  were  not  available  for  each  of  these  five  subject  areas  was  not 
considered  in  the  study. 

The  total  data  from  each  sheet  was  punched  on  to  a  deck  of  IBM 
master  cards.  Input  cards  for  the  computer  were  made  by  drawing  appro¬ 
priate  data  from  the  master  cards. 
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Statistical  Analysis 

The  basic  analysis  was  conducted  at  the  Computing  Center, 
University  of  Alberta  by  the  Stepwise  Regression  program  (1963)  in 
accordance  with  the  stated  hypotheses  of  the  present  study.  This  program 
derives  the  means  and  variances  of  the  predictor  variables  and  the 
criterion,  the  intercorrelation  matrix,  the  multiple  correlation  coeffic¬ 
ient  between  various  combinations  of  predictor  variables  with  the 
criterion,  and  the  multiple  regression  equations. 

The  differences  between  means  we re  tested  for  significance  by  the 
conventional  t-test.  Significance  of  differences  between  variances  was 
tested  by  a  conventional  F-test.  The  accepted  levels  of  significance 
were  considered  to  be  .05  and  .01  as  indicated  on  the  tables. 

The  score  weights  of  each  of  the  predictor  variables  in  the 
regression  equations  were  compared  on  the  basis  of  a  transformed  Beta 
weight  in  which: 


- 


where  -^3  is  the  relative  beta  weight 

Sp  and  sc  are  the  standard  deviations  of 
the  predictor  and  criterion  variables, 
b  is  the  score  weighting  from  the  computer 
output  for  the  predictor  variable. 


The  significance  of  differences  between  the  multiple  correlation 
coefficients  was  tested  by  the  z-test  in  which: 
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where  and  Zrp  are  the  Fisher's 

transformations  of  the 
multiple  correlation  coeffici¬ 
ents  and  the  denominator 
represents  the  standard  error 
of  difference  between  the  two 
z '  s . 


The  levels  of  alpha  error  less  than  .05  and  less  than  .01  were  considered 
as  indicating  significance. 
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CHAPTER  IV 


THE  EFFECT  OF  SCHOOL  SIZE  ON  PREDICTION  OF  FRESHMAN  SUCCESS 

Earlier  studies  have  found  that  the  amount  of  success  in  using 
high  school  marks  to  predict  university  success  was  related  to  the  size 
of  high  school  from  which  a  student  graduated.  The  marks  from  larger 
schools  have  been  shown,  generally,  to  he  the  more  valid  predictors  (Bou 
and  Stove 11,  1950;  Bloom  and  Peters,  1961)0 

To  test  the  hypothesis  that  marks  of  students  from  larger  high 
schools  would  he  better  predictors  of  academic  success  at  the  University 
of  Alberta  than  marks  of  students  from  smaller  high  schools,  the  data  was 
grouped  on  the  basis  of  size  of  high  school  from  which  the  student  gradu¬ 
ated.  The  criterion  used  to  determine  the  size  of  school  was  the  number 
of  teachers  on  the  high  school  staff.  The  faculty  sizes  of  the  high 
schools,  for  the  sample  of  students  considered  in  the  present  study,  ranged 
from  three  to  seventy -five  teachers.  The  number  of  staff  in  each  high 
school  was  determined  from  a  listing  of  ''Approved  Secondary  Schools  in 
Alberta,"  published  yearly  by  the  Department  of  Education  from  school 
statistics  submitted  in  the  fall. 

To  facilitate  an  examination  of  the  effect  of  school  size  the 
schools  were  grouped  into  seven  categories,  as  shown  on  Table  XI.  The 
means  and  standard  deviations  of  the  predictor  and  criterion  variables 
were  computed  and  tabulated  for  each  of  the  seven  school-size  categories. 
The  multiple  correlation  between  the  predictor  variables  and  the  criterion, 
first-year  university  average,  and  the  relative  contributions  of  each  of 
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TABLE  XI 

NUMBER  OF  FRESHMEN  FROM  HIGH  SCHOOLS  OF  VARYING  SIZE 
AS  DETERMINED  BY  NUMBER  OF  TEACHERS 


SCHOOL  SIZE 
CATEGORY 

NUMBER  OF 
TEACHERS 

SAMPLE  SIZE 

N 

1 

1  -  5 

101 

2 

6-10 

204 

3 

11  -  15 

109 

4 

16  -  20 

115 

5 

21  -  25 

88 

6 

26  -  50 

187 

7 

51  -  75 

213 
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table  XII 

MEANS  AND  STANDARD  DEVIATIONS  OF  DEPARTMENTAL  LARKS  AND  PRINCIPAL  RATINGS 
AND  UNIVERSITY  AVERAGE  OF  STUDY  SAMPLE  BY  SIZE  OF  SCHOOL 
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TABLE  XIII 

MULTIPLE  CORRELATION  COEFFICIENTS  BETWEEN  PREDICTOR  VARIABLES 
AND  UNIVERSITY  AVERAGE  FOR  VARIOUS  SCHOOL-SIZE  GROUPS 


SIZE  OF  SCH. 
CATEGORY 

N 

DEPARTMENTAL 

PRINCIPAL  RATING 

rD 

SRest 

rpr 

SEest 

1 

101 

.643 

6.26 

.643 

6.25 

2 

204 

•567 

7o8l 

.576 

7.76 

3 

109 

.586 

8o24 

.516 

8.71 

4 

115 

.570 

8.29 

o6l4 

7.96 

5 

88 

.585 

8.98 

.501 

9.58 

6 

187 

.721 

7.78 

.672 

8.31 

7 

213 

.7  66 

7.48 

.728 

7.98 

TOTAL 

1017 

.636 

7.99 

.605 

8.24 
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the  predictor  variables  in  the  regression  equations  were  also  determined 
for  each  group. 

Ranking  of  the  means  for  predictor  and  criterion  variables  from 
the  data  shown  in  Table  XII ,  indicates  that  Departmental  marks  of 
students  from  large  schools,  school-size  categories  6  and  "J ,  consistently 
ranked  in  the  highest  three.  There  was  a  tendency  for  the  variation  in 
marks,  as  indicated  by  the  standard  deviation,  to  be  greater  for  students 
from  the  two  largest  sizes  of  school.  A  similar  pattern  existed  within 
the  Principals’  Ratings. 

The  size  of  the  multiple  correlation  coefficients,  reported  in 
Table  XIII,  divided  the  seven  categories  of  schools  into  two  distinct 
groups.  The  large  schools,  i.e.,  categories  6  and  7  or  schools  with  more 
than  twenty-five  teachers  on  staff,  had  multiple  correlation  coefficients 
of  .721  and  .766  compared  to  those  of  smaller  schools  which  ranged  from 
.567  to  .643  when  the  Departmental  scores  were  used  to  predict  freshman 
success.  The  same  pattern  exists  when  Principals’  Ratings  are  used 
although  the  dichotomy  is  not  as  pronounced,  the  large  school  multiple 
correlation  coefficients  being  .672  and  .782  compared  to  coefficients 
ranging  from  .  501  to  .643  for  small  schools. 

The  high  school  marks  of  the  t wo  largest  school-size  categories 
were  similar  in  both  their  higher  predictive  value  with  university  success 
and  their  comparatively  larger  means  and  standard  deviations.  On  this 
basis,  the  seven  categories  of  school  sizes  were  reduced  to  two.  Cate¬ 
gories  one  to  five  were  combined  into  a  "small  high  school"  group, 
schools  having  up  to  25  teachers,  for  the  purpose  of  further  analysis. 
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Schools  in  categories  6  and  'J  f  having  26  to  75  teachers,  were  categorized 
as  "large  high  schools."  This  division  of  school  sizes  appeared  to  be 
compatible  with  that  of  Bou  and  Stovell  (1950)  who  grouped  schools  into 
large  and  small  categories  on  the  basis  of  size  of  student  body- -small 
schools  had  less  than  $00  students,  large  schools  had  500  and  over. 

The  data  for  students  from  each  of  these  two  new  school-size 
groups  were  considered  separately  and  means,  standard  deviations,  and 
multiple  correlation  coefficients  were  calculated  for  these  two  categories „ 
These  statistics  are  reported  in  Tables  XIV  and  XV. 

Table  XIV  shows  that  the  mean  scores  and  the  standard  deviations 
tended  to  be  greater  for  the  large  high  school  group  than  for  the  small 
school  group.  The  differences  between  the  mean  scores  of  the  two  school- 
size  groups  were  statistically  significant  for  all  of  the  predictor 
variables  in  the  Departmental  battery;  the  differences  were  significant 
for  only  the  Social  Studies  and  Foreign  Language  variables  in  the 
Principals’  Rating  battery.  Thus,  although  students  of  large  high  schools 
actually  received  higher  marks  in  the  Depart mentals,  their  Principals’ 
Ratings  were  not  significantly  greater  for  all  of  the  variables.  The 
variances  of  scores  in  the  large  high  school  group  tended  to  be  greater 
than  the  variances  of  small  school  scores  for  both  the  Departmentals  and 
the  Principals’  Ratings  (Table  XIV).  The  university  average  was  both 
greater  and  more  variable  for  students  from  large  high  schools  as  com¬ 
pared  to  those  from  small  schools. 

The  marks  from  larger  schools,  both  Departmentals  and  Principals' 
Ratings,  were  consistently  better  predictors  of  university  success  than 
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TABLE  XV 

MULTIPLE  CORRELATION  COEFFICIENTS  BETWEEN  PREDICTOR  VARIABLES 
AND  UNIVERSITY  AVERAGE  FOR  TWO  SCHOOL-SIZE  GROUPS 


SCHOOL 

S  I  Z 

E 

MARK 

SMALL 

N  =  617 

LARGE 

N  =  LOO 

SIG.  OF  DIFF. 

Rs 

SEest 

rL 

SEest 

Rs  ■  RL 

Departmental 

.560 

7.93 

•735 

7.71 

.01 

Principal  Rating 

.558 

7.95 

.697 

8.16 

.01 

••  '  M  ..  •  'CM'  v  ..  ..'M.,  :  L  . . 
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the  marks  from  smaller  schools  (Table  XV).  The  comparison  of  correlation 
coefficients  cetween  high  school  marks  and  university  average  indicated 
that  the  superiority  of  marks  from  the  larger  schools  to  predict  freshman 
success  was  significant  at  the  .01  level. 

On  the  basis  of  the  above  evidence ,  it  was  felt  worthwhile  to  main¬ 
tain  the  differentiation  between  students  from  the  two  larger  school-size 
groups.  The  first  hypothesis  of  this  study,  that  the  correlation  between 
high  school  marks  and  university  average  would  be  greater  for  students 
from  larger  high  schools  than  those  from  smaller  schools,  was  substanti¬ 
ated  as  well. 

An  examination  of  the  relative  beta  weights,  which  were  derived 
from  the  score  weights  obtained  from  the  computer,  revealed  that  the 
Science  Average  was  consistently  the  greatest  contributor  to  the  pre¬ 
dictive  battery  (Table  XVI ).  For  students  of  small  high  schools,  the 
Mathematics  Average  made  a  negative  contribution  to  the  battery „  For 
students  of  large  schools,  the  smallest  contribution  to  the  battery  was 
that  of  the  Social  Studies  30  mark.  The  comparison  of  relative  beta  weights 
served  to  further  justify  differentiating  students  on  the  basis  of  having 
attended  high  schools  of  the  two  size  categories. 

In  summary,  the  development  of  separate  regression  equations  based 
upon  school-size  groups  was  felt  to  be  justified  because  there  were  real 
differences  among  these  groups  in  the  performance  on  predictor  and 
criterion  variables,  in  the  multiple  correlation  coefficients  between 
high  school  marks  and  university  freshman  average,  and  in  the  beta  weights 
of  individual  predictors  in  the  battery.  The  differentiation  on  the  basis 
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of  two  school  sizes,  then,  was  found  to  he  as  effective  as  the  different¬ 
iation  among  seven  size  categories.  This  two  school-size  categorization, 
small  high  schools  consisting  of  schools  with  25  or  less  teachers  and 
large  high  schools  with  more  than  25  teachers,  was  adopted  as  the  basis 
of  classification  of  data  relating  to  school  size  and  was  used  for  the 
remainder  of  the  analyses  in  this  study. 
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TABLE  XVI 

RELATIVE  BETA  WEIGHTS  OF  PREDICTORS  OF  UNIVERSITY  FRESHMAN 


AVERAGE  FOR  TWO 

SCHOOL-SIZE 

GROUPS 

H.S. 

RELATIVE  BETA  WEIGHTS  FOR  PREDICT 

CORS 

SIZE 

MARK 

N 

R 

English 

Soc.  Studies 

Math. 

Science 

Foreign 

30 

30 

Av. 

Av. 

Language 

Small 

P.Ro 

617 

.558 

.206 

.132 

-.031 

.295 

.055 

Dept. 

.560 

.112 

.214 

-.017 

.279 

.160 

Large 

P.R. 

400 

.697 

.170 

.125 

.146 

ro 

V/l 

ON 

.180 

Dept. 

•735 

■  175 

.128 

.172 

.274 

.199 
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CHAPTER  V 

EFFECT  OF  FACULTY  ENTERED  ON  PREDICTION  OF  FRESHMAN  SUCCESS 

The  improvement  of  the  prediction  of  freshman  success  has  been 
enhanced  by  considering  the  freshman  criterion  performance  by  courses 
(Zurowski,  1959 J  Black,  i960).  Such  breakdowns,  however,  fail  to 
distinquish  between  faculties  because  of  the  overlapping  course  programs, 
notably  in  Arts,  Education,  and  Science  whose  students  take  courses  in 
the  other  faculties.  Mack  (1963)  examined  the  problem  for  four  faculties, 
Arts,  Education,  Engineering  and  Science,  finding  that  high  school 
averages  were  better  predictors  of  freshman  success  when  considered  by 
faculty  entered.  This  chapter  examines  the  influence  of  individual  com¬ 
ponents  of  the  high  school  average  for  the  same  four  faculties  studied  by 
Mack. 

The  study  sample  was  classified  by  faculty  entered  and  the  means, 
standard  deviations  for  the  predictor  and  criterion  variables,  the 
multiple  correlation  coefficients  between  predictors  and  criterion  vari¬ 
ables,  and  the  regression  equations  using  both  Departmental  and  Principals’ 
Rating  scores  were  calculated.  These  findings  are  reported  in  Tables 
XVII,  XVIII,  and  XIX. 

A  comparison  of  the  faculty  differences  in  the  ranking  of  the  mean 
scores  on  predictor  variables  indicated  that  a  striking  pattern  existed 
for  each  faculty  (Table  XVII ).  By  inspection  alone,  it  was  obvious  that 
students  entering  each  of  the  four  faculties  tended  to  reflect  the  pre¬ 
requisites  of  that  faculty.  A  comparison  using  the  Freidman  Two-way 


.  t ...  •  ;  '  , 

. 

; 

■  . 

■  .  .  :  . 

.  c . 

•  .  Jci  • i  f  . 

■  .... 

.  Ki ;  .. 

•  • 

J  ....  rlc.j£)  ;  Xiod'iiS  t.jnebufa 


i 


64 


H 

H 


EH 


ft 

O 

a 

w 

Eh 

a 

o 


ft 

o 

e 

M 

ft 


CO 

P-i 

ft 

s 


H 
ft 
O 

ft  pS 

°  x 
co  5 
ft  o 
O  ft 
H 

eh  « 
<  a 
H  ft 

ft  CO 

fta 


ft 


a 


CO 


>H 

a 

ft 

g 


ft 

o 

ft  i — 1 
ft  VQ 
M  OJ 
O 
CO 


s 

§!& 
o  on 

s 

0 


CO  VO 

FH  LfN 

ft  OJ 


ft 


to 


lx: 


CO 


IX 


CO 


IX 


co 


IX 


00-4 

vo  co 

•  • 

O  O 

iH  r— 1 


OJ  LfN 
O  -4 

o  o 

O  rH 

i — I  i — 1 


LfN  VO 

VO  o 

•  • 

h  on 

i — i  i — i 


on  on 

H  -4 

•  • 

O  H 

i — I  i — I 


CO  rH 

on  on 


a 


-4 
I — I 


x  o 
CO  gn 

•  • 

On  X 

vo  vo 


CO  H 

X-  OJ 

•  o 

OJ  OJ 
X-  X- 


s 


x 

X 


OJ  H 
X-  X 


vo  on 
x-  OJ 

o  • 

on  h 

X-  x 


X  ON 
ON  CO 

CO  CON 

VO  vo 


-4-  ON 
LfN  X 

o  o 

ON  O 

H 


on  oj 
CO  -4 

•  o 

On  O 


LfN  _4 
VO  LfN 

O  • 

O  ON 

H 


vo  on 
oo  H 

CO  ON 


CO  OJ 
vo  on 

°‘a 


i — I 


ON  OJ 
ON  CO 

•  9 

VO  -4 
VO  VO 


LTN  o 

00  H 

•  o 

O  H 
X-  X 


ITNVO 

O  00 

•  • 

-4  on 
X-  X 


X-  OJ 

o  o 

•  • 

-4  O 

(X-  X 


on  co 
OJ  OJ 

o  • 

x  on 
vo  vo 


co  OJ 

o  o 

•  • 

O  ON 
I — I 


X  ON 

on  x 

ON  ON 


LTN  H 

XVO 

•  • 

ON  i — I 
rH 


OJ  LfN 
VO  ON 

•  • 

Xco 


i  I  o 

O 

aa 


VO  H 
ON  ON 

•  o 

X  LfN 
VO  vo 


LfN  H 

VO  i — I 

•  • 

vo  X 
vo  vo 


vo  vo 
vo  vo 

•  • 

on  on 

VO  vo 


CO  -4 
X  ON 

a  • 

VO  LfN 
VO  VO 


CO  O 
LfN  OJ 

o  • 

CO  IfN 
VO  VO 


o 

on 

ft 

co 

H 

►4 

ft 


o 

on 

co 

H 

H 

ft 

I 

CO 


O 


ft 

I 

ft 


ft 

ft 


X 

on 

o 

OJ 


-4 

X 

OJ 

VO 


O 

rH 

on 

H 


ON 

-4 

X 

LfN 


on 

o 

a 

CO 


ON 

ON 

ON 

LTN 


o 

rH 

-4  H 

on  oj 

vo  on 

X-4 

OJ 

-4 

Lf\ 

on  x 

ON -4 

X  OJ 

OJ  LfN 

LfN 

• 

o 

•  • 

o  o 

•  • 

•  • 

• 

o 

ON 

O  H 

O  OJ 

On  i— 1 

OJ  oo 

On 

1 — 1 

( — 1  rH 

rH  rH 

H 

rH  rH 

rH  rH 

on  co 

ON  H 

-4  X 

ft-  CO 

X 

LfN  X 

OJ  OJ 

on  i — ( 

ON  rH 

LfN  LfN 

LfN 

•  • 

•  o 

•  o 

•  • 

•  • 

o 

OJ  ON 

on  H 

LfN  on 

XVO 

rH  X 

1 — 1 

XVO 

X  X 

vo  VO 

vo  vo 

XVO 

vo 

• 

• 

• 

o 

• 

p  • 

-p  9 

p  • 

p  • 

p  9 

ft  ft 

ft  ft 

ft  ft 

ft  ft 

Ph  ft 

<u  • 

a)  * 

CD  • 

<D  • 

CD  • 

a  ft 

ft  ft 

ft  ft 

ft  ft 

ft  ft 

ft 

ft 


5 

x 

EH 

H 

co 


65 

Analysis  of  Variance  by  Ranks  (Siegel,  1956;  pp.  166-172),  rejected  the 
hypothesis  that  the  ranks  in  the  mean  scores  of  the  predictor  variables 
were  randomly  distributed  among  the  faculties.  Students  who  entered  Arts 
had  the  highest  mean  scores  in  three  variables --English  30^  Social  Studies 
30,  and  Foreign  Language--and  the  lowest  or  second  lowest  scores  in 
Mathematics  and  Science.,  The  opposite  pattern  was  shown  by  Engineering 
students  who  had  the  highest  or  second  highest  marks  in  Science  Average 
and  Mathematics  Average  and  the  lowest  or  second  lowest  in  the  other 
variables.  Students  who  entered  the  Science  Faculty  had  the  second  high¬ 
est  mean  scores  in  all  variables  except  the  Principals’  Ratings  in  Science, 
in  which  they  ranked  highest.  Students  who  entered  Education,  on  the 
other  hand,  had  the  lowest  or  second  lowest  mean  scores  in  all  of  the 
predictor  variables. 

The  comparison  of  the  multiple  correlations  between  high  school 
scores  and  university  average  for  each  of  the  faculties  provided  further 
evidence  to  support  separate  consideration  fo  the  faculties.  The 
multiple  correlations  between  the  Departmental  marks  and  the  university 
average  ranged  from  .596  for  Education  to  .750  for  Engineering;  multiple 
correlations  between  the  Principals’  Ratings  and  the  university  average 
ranged  from  -584  for  Education  to  .713  for  Science  (Table  XVTIl).  For 
both  sets  of  predictors,  the  correlations  with  university  marks  in 
Engineering  and  Science  were  consistently  better  than  the  correlations 
with  marks  in  Arts  and  Education. 

The  relative  contributions  of  the  predictor  variables,  as  indicated 
by  their  relative  beta  weights,  shown  in  Table  XIX,  varied  from  one 
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TABLE  XVIII 


MULTIPLE  CORRELATIONS  BETWEEN  PREDICTOR  VARIABLES  AND  UNIVERSITY 
AVERAGE  FOR  FOUR  FACULTY  GROUPS  AND  SIGNIFICANCE  OF  DIFFERENCES 
BETWEEN  FACULTY  MULTIPLE  CORRELATION  COEFFICIENTS 


FACULTY 

MULT.  CORR. 

PRED-UNIV.  AV. 

SIGo  OF  DIFF. 

BETWEEN  R's 

ARTS 

EDUC. 

ENG. 

SCI. 

DEPARTMENTAL  EXAMINATIONS 

ARTS 

•653 

— 

NSD 

.10 

.10 

EDUCATION 

.596 

- 

.05 

.01 

ENGINEERING 

.750 

- 

NSD 

SCIENCE 

•  737 

•• 

PRINCIPALS’  RATINGS 

ARTS 

.607 

mm 

NSD 

NSD 

.05 

EDUCATION 

.584 

- 

NSD 

.01 

ENGINEERING 

•633 

- 

NSD 

SCIENCE 

.713 
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faculty  to  another.  Generally,  there  was  a  comparatively  close  relation¬ 
ship  between  the  magnitude  of  the  contribution  by  the  Departmental  and 
Principals’  Rating  scores  from  the  same  subject  area.  Two  exceptions  were 
found,  both  in  the  Faculty  of  Science »  The  English  30  mark  made  a 
markedly  greater  contribution  to  the  Principals’  Rating  battery  but  was 
the  smallest  contributor  in  the  Departmental  battery.  The  Social  Studies 
30  mark  showed  the  opposite  effect.  It  made  a  greater  contribution  to 
the  Departmental  battery  than  to  the  Principals’  Rating  battery. 

The  relative  beta  weight  for  English  30  was  comparatively  large 
for  the  Faculties  of  Arts  and  Science.  In  the  prediction  of  Engineering 
marks,  it  had  a  negative  weighting  of  considerable  magnitude. 

The  contribution  of  Social  Studies  30  was  greater  than  that  of  any 
other  predictor  variable  for  the  Faculty  of  Education  group.  Social 
Studies  30  made  a  moderate  contribution  to  the  prediction  of  university 
average  for  Engineering  students  and  to  the  Departmental  battery  for 
Faculty  of  Science  marks  but  a  sma.ll  and  negative  contribution  to  pre¬ 
diction  in  the  Faculty  of  Arts. 

The  Mathematics  Average  made  little  contribution  to  the  prediction 
of  averages  in  Arts  and  Education.  The  Mathematics  mark,  as  might  be 
expected,  made  a  sizeable  contribution  to  prediction  in  the  Faculties  of 
Engineering  and  Science. 

As  in  earlier  studies  (Zurowsky,  1959;  Black,  i960),  the  present 
study  found  that  the  Grade  XII  Science  Average  was  consistently  a  major 
contributor  to  the  predictive  batteries.  Its  relative  beta  weight  was 
particularly  large  in  the  Arts  and  Engineering  faculties.  The  Science 
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Average  was,  however,  one  of  the  smaller  contributors  in  predicting 
averages  in  the  Faculty  of  Education. 

The  Foreign  Language  mark  made  a  moderate  contribution  in  predict¬ 
ing  marks  in  all  faculties  but  Engineering,  where  its  contribution  was 
negligible . 

In  summary,  there  appeared  to  be  significant  faculty  differences 
in  the  performance  by  students  in  the  predictor  and  criterion  variables 
and  in  the  relationship  between  predictors  and  criteria. 

A  comparison  of  the  mean  scores  indicated  that  students  who  enrolled 
in  each  faculty  had  certain  relative  strengths  and  weaknesses  in  their 
performances  on  the  variables --differences  that  formed  unique  faculty 
patterns,  and  no  doubt  determined  in  part  by  both  the  prerequisites  of 
courses  in  the  faculties  entered  and  the  interest  and  aptitude  shown  by 
the  student  choosing  that  faculty. 

Differences  of  statistical  significance  were  found  among  the  mul¬ 
tiple  correlations  between  the  predictor  and  criterion  variables  for  each 
of  the  four  faculties  considered  in  the  study.  Correlations  for  the 
faculty  groups  of  Science  and  Engineering  were  generally  greater  than 
correlations  for  Arts  and  Education.  The  correlations  for  the  Faculty  of 
Education  group  were  consistently  lower  than  that  of  other  faculties. 

The  contributions  of  each  of  the  predictors,  as  indicated  by  the 
relative  beta  weights,  varied  considerably  among  the  faculty  groups.  The 
Grade  XII  Science  Average  had  a  heavy  beta  weighting  for  the  Arts  and 
Engineering  groups.  The  greatest  beta  weighting  for  the  Education  group 
was  for  Social  Studies  30.  Greatest  contribution  for  Faculty  of  Science 
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average  was  the  English  30  mark  in  the  Principals 1  Rating  battery  and  the 
Science  average  in  the  Departmental  battery. 

It  was  concluded  that  there  was  sufficient  evidence  to  accept  the 
hypothesis  that  the  correlation  between  high  school  marks  and  university 
average  would  differ  according  to  the  faculty  in  which  the  students  were 
enrolled.  The  development  of  separate  regression  equations  for  each 
faculty  was  thereby  justified  on  these  as  well  as  a  priori  evidence  from 
selective  admission  practices  most  evident  in  the  Faculties  of  Science 
and  Engineering. 
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CHAPTER  VI 


EFFECT  OF  SEX  DIFFERENCES  ON  PREDICTION  OF  FRESHMAN  SUCCESS 

Academic  prediction  of  freshman  success  has  "been  found  to  he  more 
successful  for  female  students  than  for  males  (Abelson,  1952;  Garrett, 
1949;  Lewis,  1962;  and  Seashore,  1962).  Not  only  have  high  correlations 
between  predictors  and  criterion  been  found  for  females,  the  variability 
of  scores  has  been  found  to  be  smaller  for  females  (Abelson,  1952).  This 
chapter  will  report  the  examination  of  the  hypotheses,  first,  that  the 
correlation  between  high  school  marks  and  freshman  average  at  the 
University  of  Alberta  would  be  greater  for  female  subjects  than  for  male 
subjects  and,  secondly,  that  female  predictor  and  criterion  variables 
would  have  a  greater  variance  than  would  the  male  variables.  These  hypo¬ 
theses  were  tested  in  four  steps.  First,  the  means,  standard  deviation, 
and  multiple  correlation  coefficients  for  both  sets  of  predictor  and 
criterion  variables  were  calculated  for  the  total  sample  of  457  female  and 
560  male  students.  Secondly,  the  sex  breakdown  was  examined  in  the  two 
school  categories  evolved  in  Chapter  IV;  and  thirdly,  for  the  faculty 
categories o  Finally,  the  total  sample  was  grouped  on  the  combined 
categories  of  sex  of  the  student,  size  of  graduating  high  school,  and 
faculty  entered  at  the  university. 

At  each  stage  of  this  categorization  of  data,  the  two  hypotheses 

were  tested  and  the  findings  reported. 
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Total  Group 

The  means  and  standard  deviations  for  the  total  sample  of  males 
and  females  were  computed  for  each  of  the  predictor  variables  and  differ¬ 
ences  between  the  performance  of  the  two  groups  were  analyzed  (Table  XX  )• 

The  female  group  was  found  to  have  a  higher  mean  score  and  a 
smaller  variance  of  scores  than  the  male  group  on  the  criterion,  first- 
year  university  average  (Table  XX).  The  superior  university  average 
would  be  due,  in  part,  to  the  absence  of  female  students  in  the  Faculty 
of  Engineering  which  had  lower  average  marks  than  the  ether  faculties 
(Table  XVII ). 

The  differences  between  the  male  and  female  groups  in  their  per¬ 
formances  on  the  predictor  variables  were  not  entir  ely  consistent  with 
findings  of  earlier  studies,  notably  Abelson  (1952)  and  Seashore  (1963) 
who  had  concluded  that  the  variability  of  scores  was  less  for  the  female 
group.  The  two  variables  in  which  a  significantly  smaller  variance  was 
found  for  the  female  group,  the  Principals’  Rating  scores  in  English  30 
and  Foreign  Language,  were  similar  in  that  each  was  a  teacher’s  rating, 
as  compared  to  the  Departmental  Examination,  in  subject  areas  in  which 
the  mean  scores  were  significantly  higher  for  female  students  (Table  XX ). 
The  scores  of  male  students  were  significantly  less  variable  in  the 
Principals’  Rating  of  Social  Studies  30,  a  subject  in  which  the  mean 
score  was  greater  for  male  students.  Male  students  also  had  a  higher 
mean  score  in  the  Science  Average  and  in  Social  Studies  jO. 

The  multiple  correlations  between  the  predictor  variables  and  the 
university  freshman  average  were  somewhat  greater  for  the  iemale  group 
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TABLE  XX 


MEANS  AND  STANDARD  DEVIATIONS  OF  PREDICTOR  AND  CRITERION  VARIABLES 
FOR  MALE  AND  FEMALE  TOTAL  GROUPS  AND  TESTS  OF  SIGNIFICANCE  OF 
DIFFERENCE  BETWEEN  THESE  STATISTICS 


VARIABLE 

SAMPLE 

SIGNIFICANCE 

OF 

DIFFERENCE 

STATISTIC 

MALES  (N  =-560) 

FEMALES 

(N  =  457) 

r 

s 

X 

s 

X 

s 

ENGLISH  30 

P.  R. 

65.42 

10.16 

69.54 

9.21 

.01 

.01 

DEPT . 

67.16 

9.94 

72.36 

10.29 

.01 

NSD 

SOCIAL  STUDIES  P0  R. 

70.57 

10.68 

69.01 

11.36 

.05 

NSD 

DEPT. 

71.25 

°9.54 

69.  H 

10.99 

.01 

.01* 

MATHo  AV. 

P.  R. 

68.29 

12.38 

64.58 

12.92 

.01 

NSD 

DEPT. 

69.63 

11.33 

64.86 

11.10 

.01 

NSD 

SCIENCE  AV. 

P.  R. 

67.96 

10.67 

67.52 

10.33 

NSD 

NSD 

DEPT. 

70.68 

9.51 

68.26 

9.41 

.01 

NSD 

FOR.  LANG. 

P.  R. 

63.17 

13.50 

68.99 

12.57 

.01 

.05 

DEPT. 

66.89 

11.26 

72.23 

11.64 

.01 

NSD 

UNIV.  AVERAGE 

59.83 

11.26 

62.09 

8.91 

.01 

.01 

''Hypothesis  that  female  students  will  have  smaller  variances  for 
variables  is  rejected  because  female  variance  is  significantly  larger 
than  that  found  for  male  students  at  the  it  level  of  confidence. 
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than  for  the  male  group,  but  the  differences  were  not  statistically 
significant  for  either  set  of  predictors  (Table  XXI).  The  correlation 
coefficients  for  female  students  were  greater  than  the  coefficients  for 
males  by  .062  points  in  the  Principals’  Ratings  and  .04-4  points  in  the 
Departmental  marks. 

The  weight  scores  of  the  predictor  variables  in  the  regression 
equations  for  male  and  female  students  were  transformed  to  relative  beta 
weights  and  tabulated  for  comparison  (Table  XXI).  Social  Studies  30  and 
English  30,  both  of  which  contributed  heavily  to  the  female  battery,  were 
given  comparatively  little  weighting  in  the  male  battery.  The  Mathematics 
Average  was  given  more  weighting  in  predicting  university  marks  for  male 
students  than  in  predicting  university  marks  for  female  students.  The 
Science  Average  was  a  major  contributor  to  the  predictive  batteries  of 
male  students  in  particular. 

School-size  Groups 

The  data  was  categorized  into  the  two  school-size  groups  developed 
in  Chapter  IV  of  this  study.  There  were  307  males  and  310  females  in  the 
small  high  school  group;  the  large  high  school  group  contained  253  males 
and  147  female  students. 

An  examination  of  the  performance  by  each  group  in  the  predictor 
and  criterion  variables  confirmed  the  sex  difference  found  earlier. 

On  the  university  average,  the  female  students  from  both  small  and 
large  high  schools  had  greater  mean  scores  and  smaller  variances  than  the 
comparable  male  groups  (Table  XXII ). 
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TABLE  XXII 

MEANS  AND  STANDARD  DEVIATIONS  OF  PREDICTOR  AND  CRITERION 
VARIABLE  FOR  MALE  AND  FEMALE  SCHOOL-SIZE  GROUPS 


II.  s. 

VARIABLE 

MARK 

.  MALE 

FEMALE 

SIG.  OF  DIFF. 

SIZE 

X 

H - 

_L  s 

x  I 

S 

X  \  S 

SMALL 

ENGLISH  30 

P.  R. 

65.18 

9-59 

68.45 

9.10 

.01 

NSD 

DEPT. 

66.26 

9.59 

71.17 

IO.17 

.01 

NSD 

SOC.  ST.  30  P.  R. 

69.93 

10.15 

68.95 

10.26 

NSD 

NSD 

DEPT. 

70.35 

9.67 

68.26 

10.11 

.01 

NSD 

MATH.  AV. 

P.  R. 

69.OO 

11.45 

64.78 

12.20 

.01 

NSD 

DEFT. 

69.07 

10.77 

64.32 

10.10 

.01 

NSD 

SCI.  AV. 

P.  R. 

68.96 

9.kj 

67.72 

9.07 

NSD 

NSD 

DEFT. 

70.16 

8.93 

67.91 

8.28 

.01 

NSD 

FOR.  LANG. 

P.  R. 

62.50 

12.92 

67.66 

12.06 

.01 

NSD 

DEPT. 

66.26 

10.51 

71.03 

10.69 

.01 

NSD 

UNIV.  AV. 

58.86 

10.78 

61. 04 

8.00 

.01 

.01 

LARGE 

ENGLISH  30 

P.  R. 

65.71 

10.87 

71.84 

9.05 

.01 

.05 

DEPT. 

68.26 

10.72 

74.88 

10.12 

.01 

NSD 

SOC.  ST.  30  P.  R. 

71.62 

10.32 

69.56 

12.15 

NSD 

.05* 

DEPT. 

72.35 

9.29 

71.42 

11.02 

NSD 

.01* 

MATH.  AV. 

P.  R. 

67.65 

12.73 

64.32 

13.35 

.05 

NSD 

DEPT. 

70.30 

11.96 

66.41 

11.71 

.01 

NSD 

SCI.  AV. 

P.  R. 

66.98 

11.11 

67.49 

11.32 

NSD 

NSD 

DEPT 

71.30 

10.14 

69.42 

9.93 

NSD 

NSD 

FOR.  LANG. 

P.  R. 

64.18 

13.60 

72.13 

11.89 

.01 

.05 

DEPT. 

67.65 

12.02 

75.19 

11.20 

.01 

NSD 

UNIV.  AV. 

61.00 

11.72 

64.32 

10.27 

"RSr-i 

.01 

r5or\r»(=» 

.05 

- ^Greater  "male  variability  hypothesis  rejected.  Evidence 

statistically  favors  greater  female  variability  of  scores  at  level 


indicated . 
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In  the  predictor  variables ,  the  mean  score  was  higher  for  the  female 
group  in  English  30  and  Foreign  language  for  both  school-size  groups.  The 
smaller  variance  in  the  Principals’  Ratings  of  these  two  subjects,  which 
had  been  found  for  females  in  the  total  group,  was  found  only  for  students 
who  graduated  from  large  high  schools.  In  Social  Studies  30,  the  smaller 
variance  in  both  sets  of  scores  was  for  the  male  group  in  contradiction  to 
the  hypothesis.  There  were  no  significant  differences  between  the  vari¬ 
ances  of  the  two  groups  on  the  predictor  variables  for  the  small  school 
group  (Table  XXII ).  Male  students  from  both  sizes  of  high  schools,  sur¬ 
passed  the  females  in  the  Mathematics  Average  mean  score.  In  the  small 
school  group,  the  males  had  higher  mean  scores  than  the  females  in  the 
Social  Studies  30  and  Science  Departmental  Examination. 

The  multiple  correlation  coefficients  between  high  school  marks  and 
the  university  average  were  consistently  numerically  greater  for  the  female 
group  as  compared  to  the  male  group  for  both  small  and  large  school  cate¬ 
gories  (Table  XXIII ).  For  only  one  group,  however,  was  the  difference 
between  correlations  for  male  and  female  groups  statistically  significant; 
the  correlation  coefficient  between  the  Principals’  Ratings  and  university 
average  for  the  students  who  graduated  from  large  high  schools  was  .764 
for  females  as  compared  to  .664  for  males.  This  difference  was  signifi¬ 
cant  at  the  .05  level. 

Faculty  Groups 

The  data  for  the  total  groups  of  male  and  female  students  was  cate¬ 
gorized  on  the  basis  of  faculty  in  which  the  student  was  enrolled.  Since 


..  .  Slit  i  *  .  ;  :  caw  VI  03  a  an  '3  -.tlc  r  teiios*.:  ,  •  &$  nl 

. 

.  ..  ■  ! . 

5*.e,  ;tfr.  t.  i  titt  -  a  t  u  %  1  ••>  siIJ-  nJ. .  a'.  -  x>m/  x  ns.  ■  .•  .>! 

......  .  • 

J-  .  .....  .  . 

:;..  j.  ,  .. c  \_v  '  .r:J‘  ...X  .  ;>  cIa.C:  \>  •©:  g  •' 

. 

j  .  .  :Lx  ..  J-  v.  j  I  oval  •  n.  C .  o>  jcr 

.  o  u  »r: 

...  g  u  :  .:  G.,  j  ..  :'.:c  .r. .  _*:.x  g  ic  .  .  .  jj  o1- 

-Go  g  '.;.  ..  -  :d  -.  :  '.:  .  cJ*  •..  l 

. 

.  .  .  .'  •  .  ;  • . 

■  l.JJ  l.  uiJ-.-j  1  ,:ga  cii&  .x3..^  .v. .o.:o.L-‘-.r'  o  n  .. o  ju.- .•.:  y 

...  v  ,+  ;  •..  .  .  o.  g  n:\ srzc  v 

-  !  •  * 

,  g  (JG.  e  id-  o  d  .c 


:  ai>  s  a  : 


7S 


TABLE  XXIII 

MULTIPLE  CORRELATIONS  AMD  STANDARD  ERRORS  OF  ESTIMATE  BETWEEN  PREDICTOR 
VARIABLES  AND  UNIVERSITY  AVERAGE  FOR  MALE  AND  FEMALE  SCHOOL-SIZE 
GROUPS  AND  SIGNIFICANCE  OF  DIFFERENCE  BETWEEN 
CORRELATION  COEFFICIENTS 


H.  S. 

GROUP 

% 

nf 

PRED. 

VAR. 

MULTIPLE  CORRELATION 
TOTH  UNIV.  AV. 

SIGNIFICANCE 

OF 

DIFFERENCE 

MALE 

FEMALE 

R 

S^est 

R 

S^*est 

SMALL 

307 

310 

P.R. 

.561 

9.00 

.584 

6.54 

NSD 

307 

310 

DEPT. 

o555 

9.05 

.610 

6.39 

NSD 

LARGE 

253 

147 

P.R. 

.664 

8.85 

.764 

6.75 

.05 

253 

147 

DEPT. 

.718 

8.24 

.791 

6.40 

NSD 

. 
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the  sample  01  Engineering  students  included  only  one  female  student ,  and 
she  was  classed  as  a  male  student  for  faculty  comparison,  only  the 
Faculties  of  Arts,  Education  and  Science  were  considered  at  this  stage  of 
the  study.  The  approximate  proportion  of  males  to  females  was  one  to  one 
in  Arts,  one  to  three  in  Education,  and  five  to  one  in  Science  (Table  XXIV). 

The  mean  score  of  female  students  surpassed  the  male  mean  score  in 
first-year  university  average  in  each  of  the  faculties.  No  significant 
differences  i.Tere  found  between  the  variance  in  criterion  scores  for  the 
male  and  female  groups  (Table  XXIV ). 

Female  students  entering  all  three  faculties  had  higher  mean  scores 
in  English  30  and  Foreign  Language  for  both  sets  of  predictors  as  compared 
to  the  male  mean  scores  in  these  variables.  Females  entering  the  Science 
faculty  surpassed  the  males  in  Social  Studies  30.  The  mean  score  for 
male  students  in  Education  was  higher  than  the  mean  score  for  female 
Education  students  in  the  Departmental  Mathematics  Average.  The  mean 
score  for  the  Principals '  Rating  of  the  Science  Average  was  greater  for 
males  than  females  in  Education  but  greater  for  females  than  males  in  the 
Faculty  of  Science  (Table  XXIV ) . 

Considering  the  variances  of  the  scores  of  male  and  female  students 
for  both  Departmental  and  Principals*  Rating  scores,  only  one  instance  was 
found  when  the  female  variance  was  significantly  smaller  than  the  male 
variance,  but  eight  instances  were  found  when  the  female  variance  was 
significantly  greater  than  the  male  variance.  For  the  remaining  twenty- 
four  comparisons,  no  significant  difierences  were  found.  This  evidence 
in  contrast  to  Abelson’s  (1992)  findings  would  suggest  that  the  hypothesis 
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Greater  male  variability  hypothesis  is  rejected 

Evidence  statistically  favors  greater  female  variance  at  level  indicated. 
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of  smaller  female  variances  be  rejected  and  replaced  with  one  of  no 
significant  differences  between  male  and  female  variances. 

The  multiple  correlation  between  high  school  achievement  and 
university  average  in  each  of  the  three  faculties  was  consistently 
greater  for  female  students  than  for  male  students  (Table  XXV).  The 
correlations  between  the  Arts  average  and  each  of  the  two  sets  of  pre¬ 
dictors  were  significantly  greater  for  the  female  group  at  the  .01  level. 
The  correlation  between  the  Education  average  and  Departmental  marks  was 
greater  for  the  female  group  at  the  .05  level  of  significance. 

Faculty  and  School-size  Groups 

Finally,  the  data  was  grouped  on  the  basis  of  sex  of  the  student 
for  each  of  three  faculties,  and  then  categorized  further  on  the  basis  of 
size  of  graduating  high  school.  In  this  way,  some  twelve  subgroups 
evolved.  The  multiple  correlation  coefficients  between  the  batteries  of 
high  school  marks  and  the  university  average  -were  computed  and  tabulated. 
The  difference  between  the  correlations  for  marks  of  male  and  female 
students  in  each  of  the  subgroups  was  tested  for  significance.  Tnis  is 
reported  in  Table  XXVI. 

The  multiple  correlations  for  female  students  were  consistently 
greater  than  for  males.  These  difierences  in  correlation  coqj. -icients 
were  statistically  significant  for  marks  in  Arts  and  ocience  faculties. 
None  of  the  sex  differences  in  correlations  between  high  school  marks 

and  Education  average  were  significant. 

The  standard  error  of  estimate  was  consistently  smaller  for  female 
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TABLE  XXV 


MULTIPLE  CORRELATION  COEFFICIENTS  BETWEEN  PREDICTOR  VARIABLES 
AND  UNIVERSITY  AVERAGE  FOR  MALE  AND  FEMALE  FACULTY  GROUPS 


FACULTY 

S] 

[ZE 

MARK 

CORR 

WITH  UNIVo  AV. 

SIG.  OF  DIFF. 
in  R 

MALE 

FEMALE 

MALE 

FEMALE 

R 

SEest 

R 

SEest 

ARTS 

137 

119 

P.R. 

.483 

8.51 

.696 

6.47 

.01 

DEPT 

.558 

8.08 

.746 

6.01 

.01 

EDUCATION 

106 

292 

P.R. 

.521 

6.69 

.607 

6.47 

NSD 

DEPT 

.470 

6.92 

.634 

6.29 

.05 

SCIENCE 

216 

45 

P.R. 

.698 

9.05 

.800 

7.12 

NSD 

DEPT 

.722 

8.74 

.796 

7.18 

NSD 
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MULTIPLE  CORRELATION.  COEFFICIENTS  BETWEEN  PREDICTOR  VARIABLES  AND  UNIVERSITY  AVERAGE 

FOR  MALE  AND  FEMALE  SCHOOL-SIZE  AND  FACULTY  GROUPS 
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students  than  for  male  students  in  all  subgroups  except  graduates  of 
large  high  schools  who  entered  the  Faculty  of  Education* 

Regression  Equations 

It  was  felt  that  sufficient  evidence  had  been  gathered  to  justify 
a  differentiation  of  the  data  on  the  basis  of  sex  of  the  student  (Chapter 
VI ),  size  of  graduating  high  school  (Chapter  IV ),  and  faculty  entered  at 
university  (Chapter  V).  The  multiple  correlations  between  first-year 
university  average  and  each  of  the  Principals’  Rating  and  Departmental 
Examination  batteries  were  computed  for  each  of  the  fourteen  subgroups 
formed  on  the  basis  of  these  differentiations  (Tables  XXVII  and  XXVIII ). 
The  multiple  regression  equations  to  enable  the  computation  of  university 
average  from  either  the  Principals'  Ratings  or  the  Departmentals  are 
shown  on  Tables  XXVII  and  XXVIII  together  with  the  standard  error  of 
estimate  for  each  subgroup. 

Summary 

There  appeared  to  be  consistent  differences  in  the  performance  of 
the  male  and  female  groups  in  the  predictor  and  criterion  variables. 

The  mean  score  for  females  was  consistently  and  significantly  greater 
than  the  mean  score  for  males  in  the  university  freshman  average;  the 
variance  of  female  scores  was  less  than  the  variance  of  male  scores  in 
the  university  average.  On  the  predictor  variables  there  was  a  consistent 
trend  for  female  mean  scores  to  oe  greater  in  English  _,0  and  foreign 
Language.  The  male  scores  tended  to  be  greater  in  Social  Studies  30, 
Mathematics  Average,  and  Science  Average  particularly  for  students  vho 
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graduated  from  small  high  schools  and  for  those  vho  entered  the  Faculty 
of  Science.  The  anticipated  smaller  variances  for  scores  of  female 
students  were  not  consistently  found  in  this  study ,  so  much  so  that  the 
hypothesis  relating  to  this  relationship  was  rejected. 

The  correlations  between  the  high  school  marks  being  used  as  the 
predictors  and  the  university  freshman  average  were  found  to  be  con¬ 
sistently  greater  for  females  than  for  males.  The  superiority  of  the 
female  correlation  coefficients  was  not  statistically  significant  in  all 
cases.  When  the  sample  was  considered  on  the  basis  of  school  size,  the 
female  correlation  coefficient  was  significantly  greater  than  the  male 
coefficient  only  for  the  Principals '  Hating  scores  of  students  who 
graduated  from  large  high  schools  (Table  XXIII ).  For  the  faculty  groups, 
a  statistical  difference  in  favor  of  the  female  correlation  coefficient 
was  found  for  both  the  Principals'  Rating  and  Departmental  scores  in 
predicting  the  Education  average  (Table  XXV ).  When  size  of  high  school 
and  faculty  entered  were  considered  jointly,  the  female  correlation 
coefficient  was  significantly  greater  statistically  for  the  Depart¬ 
mental  scores  of  students  graduating  from  small  schools  and  entering 
the  Faculty  of  Arts,  for  the  Principals'  Rating  scores  of  students  from 
large  schools  entering  Arts,  and  for  both  types  of  scores  of  students 
from  large  high  schools  entering  the  Faculty  of  Science  (Table  XXVI ). 

A  comparison  of  the  relative  beta  weights  of  the  individual  pre¬ 
dictors  in  the  battery  (Table  XXI )  indicated  that  the  weighting  of  the 
predictors  differs  for  the  male  and  female  batteries. 

On  the  basis  that  there  were  evidences  of  sex  differences  in 
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performance  on  predictor  and  criterion  variables  and  in  the  relationship 
between  both  sets  of  predictors  and  university  freshman  average,  a 
differentiation  between  male  and  female  students  was  felt  to  be  justified. 

Moreover,  coupled  with  sex  differences,  there  was  justification 
for  a  further  breakdown  according  to  faculty  entered  and  size  of  high 
school  from  which  the  student  had  graduated*  Regression  equations  were 
developed  to  predict  freshman  success  on  this  three-part  categorization 
for  both  Principals'  Rating  and  Departmental  Examination  scores. 


. 

' 


CHAPTER  VII 


RELATIVE  PREDICTIVE  EFFICIENCY  OF  DEPARTMENTAL  AND 
PRINCIPALS ’  RATING  SCORES 

A  major  hypothesis  of  this  study  stated  that  the  Principals’ 
Rating  scores  would  be  as  effective  predictors  of  university  freshman 
success  as  would  the  Grade  XII  Departmental  Examinations.  This  chapter 
will  seek  to  examine  this  hypothesis  in  detail. 

It  will  be  noted  in  the  earlier  chapters  reporting  the  findings 
of  the  study  that  both  Departmental  and  Principals  *  Rating  statistics 
have  been  reported  side  by  side  but  no  comparisons  were  made  other  than 
those  obvious  from  the  data  such  as  the  general  tendency  of  Principals* 
Ratings  to  underestimate  the  score  actually  achieved  in  the  Departmental 
Examination,  a  tendency  more  apparent  for  male  than  female  students,  for 
large  high  schools  than  small  schools.  This  has  been  done  on  the 
assumption  that,  for  the  purposes  of  this  study,  each  represents  a 
distinct  rating  system.  The  similarities  of  the  two  systems  of  scores, 
however,  have  been  readily  apparent  throughout  the  earlier  analyses  of 
this  study.  The  principal  reason  for  this  studies*  consideration  of 
these  two  sets  of  predictors  as  separate  systems  lies  in  the  fact  that 
the  Principals’  Ratings  could  be  available  to  the  school  counsellors  and 
university  officials  several  months  before  the  Departmental  scores.  The 
basic  point  of  comparison,  therefore,  was  the  relative  effectiveness  of 
the  Principals*  Ratings  and  the  Departmental  Examinations  to  predict 
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Following  the  pattern  of  previous  chapters,  these  comparisons  of 
Departmental  and  Principals'  Rating  scores  will  he  examined  on  the  basis 
of  a  categorization  of  the  study  sample  according  to  sex,  size  of 
graduating  high  school,  and  faculty  entered.  The  multiple  correlation 
coefficients  for  each  battery  of  scores  are  reported  in  Table  XXIX. 

Multiple  correlation  coefficients  between  the  Principals '  Rating 
battery  and  university  freshman  average  ranged  from  .488  to  .926  with  a 
median  coefficient  of  .644;  multiple  correlation  coefficients  for  the 
Departmental  battery  ranged  from  .444  to  .909  with  a  median  coefficient 
of  .672.  In  one  of  the  fourteen  subgroups,  male  Arts  students  from 
large  high  schools,  the  coefficient  of  the  Departmental-university 
correlation  (R-q  =  .733)  was  significantly  greater  statistically  than  the 
correlation  coefficient  of  Principals’  Ratings  with  the  university 
average  (Rpp>  =  *528).  In  seven  other  subgroups,  the  Departmental 
battery  produced  greater  correlation  coefficients  but  the  advantage  over 
the  Principals’  Rating  battery  was  not  statistically  significant.  In 
the  remaining  nine  subgroups,  the  difference  between  the  correlation 
coefficients  produced  by  each  of  the  batteries  was  in  favor  of  the 
Principals’  Rating  scores  but,  again,  the  differences  were  not  statis¬ 
tically  significant. 

The  Principals'  Rating  battery  was  therefore  found  to  be 
generally  as  effective  a  predictor  of  university  success  as  the  Depart¬ 
mental  Examination  battery.  When  differentiation  was  made  among  the 
data  on  the  basis  of  size  of  high  school,  faculty  entered,  and  sex  of 
student,  university  success  was  predicted  significantly  more  effectively 
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by  the  Departmental  scores  in  only  one  of  the  fourteen  subgroups.  The 
median  difference  between  the  multiple  correlation  coefficients  produced 
by  the  two  batteries  was  0o028  in  favor  of  the  Departmental  battery. 

The  practical  advantages  of  the  Principals '  Rating  in  terms  of  avail¬ 
ability  to  the  high  school  counsellor  before  the  end  of  the  Grade  XII 
program  would  appear  to  offset  the  slight  loss  in  predictive  efficiency,, 
For  University  admissions,  the  slight  loss  would  in  no  way  negate  their 
use  for  early  provisional  admission  pending  the  satisfactory  achievement 
on  the  Grade  XII  Departmental  Examinations. 
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CHAPTER  VIII 


SUMMARY,  CONCLUSIONS,  AND  APPLICATIONS 

The  general  problem  of  the  present  study  was,  first,  to  ascertain 
the  improvement  in  the  prediction  of  freshman  success  at  the  University 
of  Alberta,  Edmonton  by  studying  the  single  and  combined  categorization 
of  predictor  data  according  to  the  sex  of  the  student,  the  size  of  the 
graduating  high  school,  and  the  faculty  entered  by  the  student.  Secondly 
using  this  categorization,  the  relative  predictive  values  of  the 
Principals  *  Rating  and  Grade  XII  Departmental  Examination  scores  were 
examined. 

Data  was  collected  and  analyzed  in  accordance  with  four  hypotheses 
and  the  findings  of  this  study  were  as  follows: 

1.  It  was  hypothesized  that  high  school  marks  of  students  who  had 
attended  larger  high  schools  would  produce  greater  correlation  with 
university  average  than  would  marks  of  the  students  from  smaller  high 
schools.  The  only  such  categorization  of  size  of  high  school,  as  deter¬ 
mined  by  the  number  of  teachers  on  staff,  that  was  found  to  be  justified 
was  the  division  of  schools  into  those  with  twenty-five  or  fewer  teachers 
(small  high  schools)  and  those  with  more  than  twenty-five  teachers  (large 
high  schools).  Any  finer  categorization  was  not  warranted,  a  finding 
compatible  with  that  of  Bou  and  Stovell  (1950)  who  categorized  high 
schools  for  similar  purposes  into  those  with  less  than  500  students  and 
those  with  500  or  more  students. 
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2.  It  was  hypothesized  that  the  value  of  a  predictive  variable 
or  battery  of  variables  in  ideal  combination  would  differ  from  one 
faculty  group  to  another.  The  findings  indicated  that  the  value  of  the 
predictive  batteries  was  greatest  for  the  Faculties  of  Engineering  and 
Science,  and  least  for  Education  and  Arts,  respectively.  These  findings 
are  comparable  to  those  of  Mack  (1963)  in  rank,  but  in  every  instance, 
the  multiple  correlation  coefficients  obtained  by  this  study  were 
numerically  larger  than  the  correlations  obtained  by  Mack's  use  of  the 
high  school  average  mark.  Although  there  were  no  significant  differences 
in  the  size  of  validity  coefficients  between  Engineering  and  Science, 
and  between  Arts  and  Education  when  the  Departmental  scores  were  used  to 
predict  freshman  success,  the  magnitude  and  ranking  of  the  various  pre¬ 
dictor  variables  and  their  relative  contribution  to  the  prediction  of 
success,  would  warrant  their  separate  consideration. 

3.  It  was  hypothesized  that  the  correlation  between  high  school 
marks  and  university  average  would  be  greater  for  female  students  than 
for  male  students.  While  the  generally  consistent  finding  was  that  pre¬ 
dictions  can  be  made  more  accurately  for  female  students,  the  differences 
in  the  correlation  coefficients  were  not  always  statistically  significant. 
The  hypothesis  suggested  by  the  findings  of  Abelson  (1952)  that  scores  of 
female  students  were  less  variable  than  scores  of  male  students  was 
rejected  by  the  finding  of  this  study  that  there  were  no  consistent 
differences  in  the  variances.  There  was  some  evidence  to  support  the 
finding  by  Carter  (1953)  that  ratings  of  males  were  greater  under¬ 
estimations  of  actual  marks  than  were  ratings  of  females „ 
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4.  Finally,  it  was  hypothesized  that  the  use  of  Principals' 

Rating  scores  would  lead  to  as  great  a  correlation  with  university 
freshman  average  as  would  the  use  of  Grade  XII  Departmental  Examinations. 
For  one  of  the  fourteen  subgroups  formed  by  the  categorization  developed 
in  this  study,  there  was  statistical  evidence  to  reject  this  hypothesis 
but  in  all  other  subgroups,  the  differences  between  the  correlation 
coefficients  produced  by  each  of  the  two  predictive  batteries  were  not 
statistically  significant.  It  was  concluded  that  although  the  Depart¬ 
mental  Examinations  led  to  slightly  greater  correlations  with  university 
freshman  success  on  the  average,  the  Principals'  Rating  scores  could  be 
effectively  used  for  counselling  and  provisional  university  admission 
purposes . 

Applications 

From  this  study,  there  appeared  to  be  considerable  evidence  that 
the  regression  equations  using  Principals'  Rating  would  permit  effective 
educational  counselling  with  empirical  data  as  early  as  two  months  before 
the  end  of  the  Grade  XII  school  term. 

One  method  of  presenting  data  from  regression  equations  in  graphic 
form  for  counselling  purposes  has  been  proposed  by  Black  (i960).  An 
example  of  the  use  of  such  a  predictive  chart,  using  the  data  of  this 
study,  would  be  to  plot  the  chances  of  success,  i»s«,  earning  a  mark  01 
50  per  cent  or  better  in  first-year  university,  in  each  of  the  four 
faculties  for  a  boy  from  a  small  high  school  with  Principals'  Rating  of 
70  in  English,  65  in  Social  Studies,  80  in  Mathematics,  65  in  Science, 
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and  60  in  Foreign  Languages.  By  inserting  these  ratings  in  the  appro¬ 
priate  regression  equations,  it  would  be  found  that  this  student’s 
predicted  marks  would  be  50  in  Arts,  39  in  Education,  77  in  Engineering, 
and  74  in  Science.  To  take  into  account  the  standard  errors  of  estimate, 
the  counsellor  would  chart  the  predicted  marks  on  the  "Prediction 
Profile”  (Figure  i)  to  illustrate  the  chances  that  these  predicted  marks 
would  result  in  a  pass  mark  on  the  basis  of  performance  by  past  years' 
students. 

The  expectancy  chart  suggested  by  Mack  (1963),  while  extremely 
useful,  unfortunately  was  designed  for  studies  which  employed  a  single 
predictor  variable,  such  as  the  high  school  average,  and  was  not 
appropriate  for  the  multiple  prediction  technique  used  in  the  present 
study.  An  adaptation  could  be  made,  however,  by  using  predicted  scores 
from  the  regression  equations  on  one  axis  and  actual  grades  achieved  on 
the  other.  As  before,  the  problem  of  computing  the  predicted  scores 
for  large  numbers  of  students  without  calculator  and  computing  devices 
remains . 

The  Need  for  Further  Research 

The  finding  of  the  present  study  that  the  Principals'  Ratings  led 
to  nearly  as  precise  a  prediction  of  university  freshman  success  as  did 
the  Departmental  Examinations  suggested  several  areas  for  future  study. 

1.  The  technique  of  multiple  differential  prediction  tends  to 
emphasize  relationships  found  only  in  the  particular  sample  drawn. 

While  the  present  study  included  the  majority  of  the  1962-63  freshman 
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FIGURE  I 

UNIVERSITY  SUCCESS  PREDICTION  PROFILE 


GROUP:  Male  Students  from  Small  High  Schools 

DIRECTIONS:  Chart  the  total  score  from  the  regression  equations 
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class  in  the  faculties  considered,  the  results  should  he  examined  in 
light  of  cross-validation  studies  of  succeeding  first-year  classes  be¬ 
fore  general  application  of  the  findings  can  be  made.  Black  (1964)  has 
found  in  a  study  of  Engineers  at  the  University  of  Alberta  that  re¬ 
gression  equations  developed  in  1956  were  comparatively  stable  over  a 
period  of  six  years.  While  this  holds  promise  for  operational  uses,  it 
is  apparent  that  predictions  for  other  faculties  should  be  similarly 
investigated. 

2»  Consideration  should  be  taken  of  the  contribution  of  an  in¬ 
telligence  test  score  as  part  of  the  predictive  battery  with  the 
Principals’  Rating  scores.  While  it  has  been  found  that  intelligence 
tests  generally  add  little  to  the  provincial  achievement  test  battery 
score  for  prediction,  due  in  part  to  the  high  correlation  between  the 
two,  it  would  seem  possible  that  Principals'  Ratings  and  intelligence 
tests  might  well  be  relatively  uncorrelated  and  able  to  complement  one 
another  in  predicting  university  success. 

3.  Examination  of  the  predictive  abilities  of  the  average  score 
of  Principals'  Ratings  as  compared  to  that  of  the  Departmental  average 
score  should  be  made.  The  use  of  a  single  predictor  would  simplify  the 
task  of  presenting  expectancy  tables  for  counselling  purposes,  hopefully 
with  little  loss  in  predictive  efficiency. 

4.  The  problem  of  predicting  future  academic  success  from  high 
school  scores  could  well  include,  as  criteria,  success  in  institutions 
in  addition  to  the  University  of  Alberta.  The  growth  of  junior 
colleges  and  technological  institutes  necessitates  the  compiling  of  data 
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regarding  the  relationship  between  high  school  marks  and  success  in  all 
post-high  school  programs. 

5°  There  appears  to  be  a  growing  need  for  interprovincial  studies. 
The  relationship  between  Alberta  high  school  marks  and  success  in  insti¬ 
tutions  of  higher  learning  in  other  provinces  has  become  increasingly 
important  as  family  mobility  and  the  practice  of  faculty  quotas  increase 
in  Canada. 
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